From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 31CD4A00BE; Mon, 13 Dec 2021 09:23:39 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5A12941223; Mon, 13 Dec 2021 09:23:06 +0100 (CET) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 63A7241C27 for ; Mon, 13 Dec 2021 09:23:04 +0100 (CET) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 1BD1Z2H3027183; Mon, 13 Dec 2021 00:23:03 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding : content-type; s=pfpt0220; bh=iUaBcEUdZRmb2IL21d5UfChMOoeGQ/qqjActnb9bgJQ=; b=OICc9fXG7qjuvqcH4Qlqy9W6LX1CCcukbLPo9BJipxxmZ1gsTf9yZ+klWiI9IfygnFdg /2s1qE7khlDWkmRL0adphN7T6mfJC6TPSwRXeehYA01dCUGR7vdydeD4W9cc7IXkivJ3 4xeJBXGd1BRyO75ychowRw2V/Cu/IlIkBtimQJp4sdle1NIQpf53PiQjwvKv+txAmeZH h5F1e3PYAD75+hvc1yNYwGQKCuNSHxaG4a16z4rsHJPVQR/SGig5M3GgpQh+1JOAh1PR Mx0cLprP2mxS3JT00EfZCRBIsgkcRPfcj3Muncw2GBJngINZZ40mWakar830E67ZhDek sQ== Received: from dc5-exch02.marvell.com ([199.233.59.182]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3cwvmys3qt-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT); Mon, 13 Dec 2021 00:23:03 -0800 Received: from DC5-EXCH02.marvell.com (10.69.176.39) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Mon, 13 Dec 2021 00:23:02 -0800 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server id 15.0.1497.18 via Frontend Transport; Mon, 13 Dec 2021 00:23:02 -0800 Received: from BG-LT7430.marvell.com (BG-LT7430.marvell.com [10.28.177.176]) by maili.marvell.com (Postfix) with ESMTP id 476FB3F7045; Mon, 13 Dec 2021 00:22:59 -0800 (PST) From: To: , , , Pavan Nikhilesh , Shijith Thotton , Nithin Dabilpuram , "Kiran Kumar K" , Sunil Kumar Kori , Satha Rao CC: Subject: [PATCH 7/8] net/cnxk: add CN10K segregated Tx functions Date: Mon, 13 Dec 2021 13:52:24 +0530 Message-ID: <20211213082226.3646-7-pbhagavatula@marvell.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20211213082226.3646-1-pbhagavatula@marvell.com> References: <20211213082226.3646-1-pbhagavatula@marvell.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Proofpoint-GUID: 2-OhrkjIMUUvkEjXB_dDeJ94EjuR_Nqy X-Proofpoint-ORIG-GUID: 2-OhrkjIMUUvkEjXB_dDeJ94EjuR_Nqy X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.790,Hydra:6.0.425,FMLib:17.11.62.513 definitions=2021-12-13_03,2021-12-10_01,2021-12-02_01 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Pavan Nikhilesh Add CN10K segregated Rx and event Tx enqueue template functions, these help in parallelizing the build. Signed-off-by: Pavan Nikhilesh --- drivers/event/cnxk/tx/cn10k/tx_0_15.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_112_127.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_16_31.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_32_47.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_48_63.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_64_79.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_80_95.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c | 11 +++++++++++ drivers/event/cnxk/tx/cn10k/tx_96_111.c | 10 ++++++++++ drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_0_15.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_112_127.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_16_31.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_32_47.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_48_63.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_64_79.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_80_95.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_96_111.c | 11 +++++++++++ drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c | 12 ++++++++++++ drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c | 12 ++++++++++++ 48 files changed, 544 insertions(+) create mode 100644 drivers/event/cnxk/tx/cn10k/tx_0_15.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_112_127.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_16_31.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_32_47.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_48_63.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_64_79.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_80_95.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_96_111.c create mode 100644 drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_0_15.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_112_127.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_16_31.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_32_47.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_48_63.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_64_79.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_80_95.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_96_111.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c create mode 100644 drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c diff --git a/drivers/event/cnxk/tx/cn10k/tx_0_15.c b/drivers/event/cnxk/tx/cn10k/tx_0_15.c new file mode 100644 index 0000000000..9ae761ba39 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_0_15.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_0_15 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c b/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c new file mode 100644 index 0000000000..58c77dac0e --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_0_15_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_0_15 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_112_127.c b/drivers/event/cnxk/tx/cn10k/tx_112_127.c new file mode 100644 index 0000000000..60dcfbb355 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_112_127.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_112_127 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c b/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c new file mode 100644 index 0000000000..bd52c5f903 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_112_127_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_112_127 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_16_31.c b/drivers/event/cnxk/tx/cn10k/tx_16_31.c new file mode 100644 index 0000000000..7fa9c02314 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_16_31.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_16_31 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c b/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c new file mode 100644 index 0000000000..c39a806688 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_16_31_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_16_31 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_32_47.c b/drivers/event/cnxk/tx/cn10k/tx_32_47.c new file mode 100644 index 0000000000..4bd1547955 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_32_47.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_32_47 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c b/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c new file mode 100644 index 0000000000..0e3d52d48c --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_32_47_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_32_47 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_48_63.c b/drivers/event/cnxk/tx/cn10k/tx_48_63.c new file mode 100644 index 0000000000..6c6a35ee9b --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_48_63.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_48_63 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c b/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c new file mode 100644 index 0000000000..2528fbf544 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_48_63_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_48_63 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_64_79.c b/drivers/event/cnxk/tx/cn10k/tx_64_79.c new file mode 100644 index 0000000000..e2c046bcde --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_64_79.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_64_79 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c b/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c new file mode 100644 index 0000000000..b7757d08e7 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_64_79_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_64_79 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_80_95.c b/drivers/event/cnxk/tx/cn10k/tx_80_95.c new file mode 100644 index 0000000000..49ba008abe --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_80_95.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_80_95 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c b/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c new file mode 100644 index 0000000000..48255e4727 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_80_95_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_80_95 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_96_111.c b/drivers/event/cnxk/tx/cn10k/tx_96_111.c new file mode 100644 index 0000000000..dd62d70c68 --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_96_111.c @@ -0,0 +1,10 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) SSO_TX(cn10k_sso_hws_tx_adptr_enq_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_96_111 +#undef T diff --git a/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c b/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c new file mode 100644 index 0000000000..511ac2f70b --- /dev/null +++ b/drivers/event/cnxk/tx/cn10k/tx_96_111_seg.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_worker.h" + +#define T(name, sz, flags) \ + SSO_TX_SEG(cn10k_sso_hws_tx_adptr_enq_seg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_96_111 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15.c b/drivers/net/cnxk/tx/cn10k/tx_0_15.c new file mode 100644 index 0000000000..a7920b7f91 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_0_15 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c new file mode 100644 index 0000000000..13a35474a1 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_0_15 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c new file mode 100644 index 0000000000..cb4091b067 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_0_15 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c new file mode 100644 index 0000000000..be1abafd79 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_0_15_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_0_15 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127.c b/drivers/net/cnxk/tx/cn10k/tx_112_127.c new file mode 100644 index 0000000000..15a3f1c567 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_112_127 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c new file mode 100644 index 0000000000..13664ae6ed --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_112_127 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c new file mode 100644 index 0000000000..079773c866 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_112_127 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c new file mode 100644 index 0000000000..9f4f2fe468 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_112_127_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_112_127 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31.c b/drivers/net/cnxk/tx/cn10k/tx_16_31.c new file mode 100644 index 0000000000..a90620434e --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_16_31 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c new file mode 100644 index 0000000000..975ccb6d3b --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_16_31 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c new file mode 100644 index 0000000000..84955841ae --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_16_31 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c new file mode 100644 index 0000000000..6380dda5d7 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_16_31_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_16_31 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47.c b/drivers/net/cnxk/tx/cn10k/tx_32_47.c new file mode 100644 index 0000000000..657de869f7 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_32_47 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c new file mode 100644 index 0000000000..5d82f7c5dc --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_32_47 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c new file mode 100644 index 0000000000..298e1604f3 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_32_47 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c new file mode 100644 index 0000000000..6e3580acf1 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_32_47_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_32_47 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63.c b/drivers/net/cnxk/tx/cn10k/tx_48_63.c new file mode 100644 index 0000000000..38fef5fcfd --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_48_63 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c new file mode 100644 index 0000000000..b916358ca3 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_48_63 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c new file mode 100644 index 0000000000..0b9bb38a21 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_48_63 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c new file mode 100644 index 0000000000..c5f63dccf6 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_48_63_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_48_63 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79.c b/drivers/net/cnxk/tx/cn10k/tx_64_79.c new file mode 100644 index 0000000000..c5b5ef24f5 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_64_79 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c new file mode 100644 index 0000000000..265e1def37 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_64_79 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c new file mode 100644 index 0000000000..6a577f7074 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_64_79 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c new file mode 100644 index 0000000000..b6e1c1ff8c --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_64_79_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_64_79 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95.c b/drivers/net/cnxk/tx/cn10k/tx_80_95.c new file mode 100644 index 0000000000..b0208999bf --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_80_95 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c new file mode 100644 index 0000000000..911f2fb50c --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_80_95 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c new file mode 100644 index 0000000000..4300340e08 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_80_95 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c new file mode 100644 index 0000000000..3409fc4f21 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_80_95_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_80_95 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111.c b/drivers/net/cnxk/tx/cn10k/tx_96_111.c new file mode 100644 index 0000000000..82903de012 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111.c @@ -0,0 +1,11 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) NIX_TX_XMIT(cn10k_nix_xmit_pkts_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_96_111 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c new file mode 100644 index 0000000000..ff84b7c64b --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_MSEG(cn10k_nix_xmit_pkts_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_96_111 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c new file mode 100644 index 0000000000..c13c33ebc0 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC(cn10k_nix_xmit_pkts_vec_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_96_111 +#undef T diff --git a/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c new file mode 100644 index 0000000000..59ef5c2fa9 --- /dev/null +++ b/drivers/net/cnxk/tx/cn10k/tx_96_111_vec_mseg.c @@ -0,0 +1,12 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(C) 2021 Marvell. + */ + +#include "cn10k_ethdev.h" +#include "cn10k_tx.h" + +#define T(name, sz, flags) \ + NIX_TX_XMIT_VEC_MSEG(cn10k_nix_xmit_pkts_vec_mseg_##name, sz, flags) + +NIX_TX_FASTPATH_MODES_96_111 +#undef T -- 2.17.1