From: Ferruh Yigit <ferruh.yigit@intel.com>
To: Jasvinder Singh <jasvinder.singh@intel.com>, dev@dpdk.org
Cc: cristian.dumitrescu@intel.com, thomas@monjalon.net
Subject: Re: [dpdk-dev] [PATCH v3 1/4] net/softnic: add softnic PMD
Date: Tue, 5 Sep 2017 15:53:13 +0100 [thread overview]
Message-ID: <97795b7b-bfb4-f9da-b847-9b313916c374@intel.com> (raw)
In-Reply-To: <20170811124929.118564-2-jasvinder.singh@intel.com>
On 8/11/2017 1:49 PM, Jasvinder Singh wrote:
> Add SoftNIC PMD to provide SW fall-back for ethdev APIs.
>
> Signed-off-by: Cristian Dumitrescu <cristian.dumitrescu@intel.com>
> Signed-off-by: Jasvinder Singh <jasvinder.singh@intel.com>
> ---
> v3 changes:
> - rebase to dpdk17.08 release
>
> v2 changes:
> - fix build errors
> - rebased to TM APIs v6 plus dpdk master
>
> MAINTAINERS | 5 +
> config/common_base | 5 +
> drivers/net/Makefile | 5 +
> drivers/net/softnic/Makefile | 56 +++
> drivers/net/softnic/rte_eth_softnic.c | 609 ++++++++++++++++++++++++
> drivers/net/softnic/rte_eth_softnic.h | 54 +++
> drivers/net/softnic/rte_eth_softnic_internals.h | 114 +++++
> drivers/net/softnic/rte_eth_softnic_version.map | 7 +
> mk/rte.app.mk | 5 +-
Also documentation updates are required:
- .ini file
- PMD documentation .rst file
- I believe it is good to update release note about new PMD
- release notes library version info, since this has public API
<...>
> +EXPORT_MAP := rte_eth_softnic_version.map
rte_pmd_... to be consistent.
<...>
> +#
> +# Export include files
> +#
> +SYMLINK-y-include +=rte_eth_softnic.h
space after +=
<...>
> diff --git a/drivers/net/softnic/rte_eth_softnic.c b/drivers/net/softnic/rte_eth_softnic.c
<...>
> +
> +static struct rte_vdev_driver pmd_drv;
Why this is required, already defined below.
And for naming, pmd=poll mode driver, drv=driver, makes "poll mode
driver driver"
<...>
> +static int
> +pmd_rx_queue_setup(struct rte_eth_dev *dev,
> + uint16_t rx_queue_id,
> + uint16_t nb_rx_desc __rte_unused,
> + unsigned int socket_id,
> + const struct rte_eth_rxconf *rx_conf __rte_unused,
> + struct rte_mempool *mb_pool __rte_unused)
> +{
> + struct pmd_internals *p = dev->data->dev_private;
> +
> + if (p->params.soft.intrusive == 0) {
> + struct pmd_rx_queue *rxq;
> +
> + rxq = rte_zmalloc_socket(p->params.soft.name,
> + sizeof(struct pmd_rx_queue), 0, socket_id);
> + if (rxq == NULL)
> + return -1;
return -ENOMEM ?
> +
> + rxq->hard.port_id = p->hard.port_id;
> + rxq->hard.rx_queue_id = rx_queue_id;
> + dev->data->rx_queues[rx_queue_id] = rxq;
> + } else {
> + struct rte_eth_dev *hard_dev =
> + &rte_eth_devices[p->hard.port_id];> + void *rxq = hard_dev->data->rx_queues[rx_queue_id];
> +
> + if (rxq == NULL)
> + return -1;
> +
> + dev->data->rx_queues[rx_queue_id] = rxq;
This assigns underlying hw queue as this soft PMD queue, what happens if
two different cores, one polls the actual hw device and other polls the
this virtual device, since both are indeed same queues?
> + }
> + return 0;
> +}
> +
<...>
> +static __rte_always_inline int
> +rte_pmd_softnic_run_default(struct rte_eth_dev *dev)
> +{
> + struct pmd_internals *p = dev->data->dev_private;
> +
> + /* Persistent context: Read Only (update not required) */
> + struct rte_mbuf **pkts = p->soft.def.pkts;
> + uint16_t nb_tx_queues = dev->data->nb_tx_queues;
> +
> + /* Persistent context: Read - Write (update required) */
> + uint32_t txq_pos = p->soft.def.txq_pos;
> + uint32_t pkts_len = p->soft.def.pkts_len;
> + uint32_t flush_count = p->soft.def.flush_count;
> +
> + /* Not part of the persistent context */
> + uint32_t pos;
> + uint16_t i;
> +
> + /* Soft device TXQ read, Hard device TXQ write */
> + for (i = 0; i < nb_tx_queues; i++) {
> + struct rte_ring *txq = dev->data->tx_queues[txq_pos];
> +
> + /* Read soft device TXQ burst to packet enqueue buffer */
> + pkts_len += rte_ring_sc_dequeue_burst(txq,
> + (void **) &pkts[pkts_len],
> + DEFAULT_BURST_SIZE,
> + NULL);
> +
> + /* Increment soft device TXQ */
> + txq_pos++;
> + if (txq_pos >= nb_tx_queues)
> + txq_pos = 0;
> +
> + /* Hard device TXQ write when complete burst is available */
> + if (pkts_len >= DEFAULT_BURST_SIZE) {
There questions:
1- When there are multiple tx_queues of softnic, and assume all will be
processed by a core, this core will be reading from all into single HW
queue, won' this create a bottle neck?
2- This logic reads from all queues as BURST_SIZE and merges them, if
queues split with a RSS or similar, that clasiffication will be lost,
will it be problem?
3- If there is not enough packets in the queues ( < DEFAULT_BURST_SIZE)
those packets won't be transmitted unless more is comming, will this
create latency for those cases?
> + for (pos = 0; pos < pkts_len; )
> + pos += rte_eth_tx_burst(p->hard.port_id,
> + p->params.hard.tx_queue_id,
> + &pkts[pos],
> + (uint16_t) (pkts_len - pos));
> +
> + pkts_len = 0;
> + flush_count = 0;
> + break;
> + }
> + }
> +
> + if (flush_count >= FLUSH_COUNT_THRESHOLD) {
FLUSH_COUNT_THRESHOLD is (1 << 17), and if no packet is sent, flash
count incremented by one, just want to confirm the treshold value?
And why this flush exists?
> + for (pos = 0; pos < pkts_len; )
> + pos += rte_eth_tx_burst(p->hard.port_id,
> + p->params.hard.tx_queue_id,
> + &pkts[pos],
> + (uint16_t) (pkts_len - pos));
> +
> + pkts_len = 0;
> + flush_count = 0;
> + }
> +
> + p->soft.def.txq_pos = txq_pos;
> + p->soft.def.pkts_len = pkts_len;
> + p->soft.def.flush_count = flush_count + 1;
> +
> + return 0;
> +}
> +
> +int
> +rte_pmd_softnic_run(uint8_t port_id)
> +{
> + struct rte_eth_dev *dev = &rte_eth_devices[port_id];
It can be possible to create a macro for this.
<...>
> +static int
> +default_init(struct pmd_internals *p,
default_mbufs_init()? default_init() on its own in not that clear.
<...>
> +static void
> +default_free(struct pmd_internals *p)
default_mbufs_free()?
<...>
> +static void *
> +pmd_init(struct pmd_params *params, int numa_node)
> +{
> + struct pmd_internals *p;
> + int status;
> +
> + p = rte_zmalloc_socket(params->soft.name,
> + sizeof(struct pmd_internals),
> + 0,
> + numa_node);
> + if (p == NULL)
> + return NULL;
> +
> + memcpy(&p->params, params, sizeof(p->params));
> + rte_eth_dev_get_port_by_name(params->hard.name, &p->hard.port_id);
You may want to check return value of this.
> +
> + /* Default */
> + status = default_init(p, params, numa_node);
> + if (status) {
> + rte_free(p);
> + return NULL;
> + }
> +
> + return p;
> +}
> +
> +static void
> +pmd_free(struct pmd_internals *p)
> +{
> + default_free(p);
p->hard.name also needs to be freed here.
> +
> + rte_free(p);
> +}
> +
> +static int
> +pmd_ethdev_register(struct rte_vdev_device *vdev,
> + struct pmd_params *params,
> + void *dev_private)
> +{
> + struct rte_eth_dev_info hard_info;
> + struct rte_eth_dev *soft_dev;
> + struct rte_eth_dev_data *soft_data;
> + uint32_t hard_speed;
> + int numa_node;
> + uint8_t hard_port_id;
> +
> + rte_eth_dev_get_port_by_name(params->hard.name, &hard_port_id);
> + rte_eth_dev_info_get(hard_port_id, &hard_info);
> + hard_speed = eth_dev_speed_max_mbps(hard_info.speed_capa);
> + numa_node = rte_eth_dev_socket_id(hard_port_id);
> +
> + /* Memory allocation */
> + soft_data = rte_zmalloc_socket(params->soft.name,
> + sizeof(*soft_data), 0, numa_node);
> + if (!soft_data)
> + return -ENOMEM;
> +
> + /* Ethdev entry allocation */
> + soft_dev = rte_eth_dev_allocate(params->soft.name);
> + if (!soft_dev) {
> + rte_free(soft_data);
> + return -ENOMEM;
> + }
> +
> + /* Connect dev->data */
> + memmove(soft_data->name,
> + soft_dev->data->name,
> + sizeof(soft_data->name));
I guess this is redundant here, allocating soft_data and rest, it is
possible to use soft_dev->data directly.
> + soft_data->port_id = soft_dev->data->port_id;
> + soft_data->mtu = soft_dev->data->mtu;
> + soft_dev->data = soft_data;
> +
> + /* dev */
> + soft_dev->rx_pkt_burst = (params->soft.intrusive) ?
> + NULL : /* set up later */
> + pmd_rx_pkt_burst;
> + soft_dev->tx_pkt_burst = pmd_tx_pkt_burst;
> + soft_dev->tx_pkt_prepare = NULL;
> + soft_dev->dev_ops = &pmd_ops;
> + soft_dev->device = &vdev->device;
> +
> + /* dev->data */
> + soft_dev->data->dev_private = dev_private;
> + soft_dev->data->dev_link.link_speed = hard_speed;
> + soft_dev->data->dev_link.link_duplex = ETH_LINK_FULL_DUPLEX;
> + soft_dev->data->dev_link.link_autoneg = ETH_LINK_SPEED_FIXED;
> + soft_dev->data->dev_link.link_status = ETH_LINK_DOWN;
For simplity, it is possible to have a static struct rte_eth_link, and
assing it to data->dev_link, as done in null pmd.
> + soft_dev->data->mac_addrs = ð_addr;
> + soft_dev->data->promiscuous = 1;
> + soft_dev->data->kdrv = RTE_KDRV_NONE;
> + soft_dev->data->numa_node = numa_node;
If pmd is detachable, need following flag:
data->dev_flags = RTE_ETH_DEV_DETACHABLE;
> +
> + return 0;
> +}
> +
<...>
> +static int
> +pmd_probe(struct rte_vdev_device *vdev)
> +{
> + struct pmd_params p;
> + const char *params;
> + int status;
> +
> + struct rte_eth_dev_info hard_info;
> + uint8_t hard_port_id;
> + int numa_node;
> + void *dev_private;
> +
> + if (!vdev)
> + return -EINVAL;
This check is not required, eal won't call this function with NULL vdev.
<...>
> diff --git a/drivers/net/softnic/rte_eth_softnic.h b/drivers/net/softnic/rte_eth_softnic.h
<...>
> +int
> +rte_pmd_softnic_run(uint8_t port_id);
Since this is public API, this needs to be commented properly, with
doxygen comment.
Btw, since there is API in this PMD perhaps api documentation also needs
to be updated to include this.
<...>
next prev parent reply other threads:[~2017-09-05 14:53 UTC|newest]
Thread overview: 79+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-05-26 18:11 [dpdk-dev] [PATCH 0/2] net/softnic: sw fall-back for traffic management Jasvinder Singh
2017-05-26 18:11 ` [dpdk-dev] [PATCH 1/2] net/softnic: add softnic PMD " Jasvinder Singh
2017-06-26 16:43 ` [dpdk-dev] [PATCH v2 0/2] net/softnic: sw fall-back " Jasvinder Singh
2017-06-26 16:43 ` [dpdk-dev] [PATCH v2 1/2] net/softnic: add softnic PMD " Jasvinder Singh
2017-08-11 12:49 ` [dpdk-dev] [PATCH v3 0/4] net/softnic: sw fall-back pmd for traffic mgmt and others Jasvinder Singh
2017-08-11 12:49 ` [dpdk-dev] [PATCH v3 1/4] net/softnic: add softnic PMD Jasvinder Singh
2017-09-05 14:53 ` Ferruh Yigit [this message]
2017-09-08 9:30 ` Singh, Jasvinder
2017-09-08 9:48 ` Ferruh Yigit
2017-09-08 10:42 ` Singh, Jasvinder
2017-09-18 9:10 ` [dpdk-dev] [PATCH v4 0/4] net/softnic: sw fall-back pmd for traffic mgmt and others Jasvinder Singh
2017-09-18 9:10 ` [dpdk-dev] [PATCH v4 1/4] net/softnic: add softnic PMD Jasvinder Singh
2017-09-18 16:58 ` Singh, Jasvinder
2017-09-18 19:09 ` Thomas Monjalon
2017-09-18 9:10 ` [dpdk-dev] [PATCH v4 2/4] net/softnic: add traffic management support Jasvinder Singh
2017-09-25 1:58 ` Lu, Wenzhuo
2017-09-28 8:14 ` Singh, Jasvinder
2017-09-29 14:04 ` [dpdk-dev] [PATCH v5 0/5] net/softnic: sw fall-back pmd for traffic mgmt and others Jasvinder Singh
2017-09-29 14:04 ` [dpdk-dev] [PATCH v5 1/5] net/softnic: add softnic PMD Jasvinder Singh
2017-09-29 14:04 ` [dpdk-dev] [PATCH v5 2/5] net/softnic: add traffic management support Jasvinder Singh
2017-10-06 16:59 ` [dpdk-dev] [PATCH v6 0/5] net/softnic: sw fall-back pmd for traffic mgmt and others Jasvinder Singh
2017-10-06 16:59 ` [dpdk-dev] [PATCH v6 1/5] net/softnic: add softnic PMD Jasvinder Singh
2017-10-09 12:58 ` [dpdk-dev] [PATCH v7 0/5] net/softnic: sw fall-back pmd for traffic mgmt and others Jasvinder Singh
2017-10-09 12:58 ` [dpdk-dev] [PATCH v7 1/5] net/softnic: add softnic PMD Jasvinder Singh
2017-10-09 20:18 ` Ferruh Yigit
2017-10-10 10:08 ` Singh, Jasvinder
2017-10-10 10:18 ` [dpdk-dev] [PATCH v8 0/5] net/softnic: sw fall-back pmd for traffic mgmt and others Jasvinder Singh
2017-10-10 10:18 ` [dpdk-dev] [PATCH v8 1/5] net/softnic: add softnic PMD Jasvinder Singh
2017-10-11 23:18 ` Thomas Monjalon
2017-10-12 8:22 ` Singh, Jasvinder
2017-10-10 10:18 ` [dpdk-dev] [PATCH v8 2/5] net/softnic: add traffic management support Jasvinder Singh
2017-10-10 10:18 ` [dpdk-dev] [PATCH v8 3/5] net/softnic: add TM capabilities ops Jasvinder Singh
2017-10-10 10:18 ` [dpdk-dev] [PATCH v8 4/5] net/softnic: add TM hierarchy related ops Jasvinder Singh
2017-10-10 10:18 ` [dpdk-dev] [PATCH v8 5/5] app/testpmd: add traffic management forwarding mode Jasvinder Singh
2017-10-10 18:24 ` Ferruh Yigit
2017-10-10 18:31 ` [dpdk-dev] [PATCH v8 0/5] net/softnic: sw fall-back pmd for traffic mgmt and others Ferruh Yigit
2017-10-10 19:09 ` Singh, Jasvinder
2017-10-09 12:58 ` [dpdk-dev] [PATCH v7 2/5] net/softnic: add traffic management support Jasvinder Singh
2017-10-09 12:58 ` [dpdk-dev] [PATCH v7 3/5] net/softnic: add TM capabilities ops Jasvinder Singh
2017-10-09 12:58 ` [dpdk-dev] [PATCH v7 4/5] net/softnic: add TM hierarchy related ops Jasvinder Singh
2017-10-09 12:58 ` [dpdk-dev] [PATCH v7 5/5] app/testpmd: add traffic management forwarding mode Jasvinder Singh
2017-10-09 20:17 ` Ferruh Yigit
2017-10-10 10:07 ` Singh, Jasvinder
2017-10-06 17:00 ` [dpdk-dev] [PATCH v6 2/5] net/softnic: add traffic management support Jasvinder Singh
2017-10-06 17:00 ` [dpdk-dev] [PATCH v6 3/5] net/softnic: add TM capabilities ops Jasvinder Singh
2017-10-06 17:00 ` [dpdk-dev] [PATCH v6 4/5] net/softnic: add TM hierarchy related ops Jasvinder Singh
2017-10-06 17:00 ` [dpdk-dev] [PATCH v6 5/5] app/testpmd: add traffic management forwarding mode Jasvinder Singh
2017-10-06 18:57 ` [dpdk-dev] [PATCH v6 0/5] net/softnic: sw fall-back pmd for traffic mgmt and others Ferruh Yigit
2017-10-09 11:32 ` Singh, Jasvinder
2017-09-29 14:04 ` [dpdk-dev] [PATCH v5 3/5] net/softnic: add TM capabilities ops Jasvinder Singh
2017-09-29 14:04 ` [dpdk-dev] [PATCH v5 4/5] net/softnic: add TM hierarchy related ops Jasvinder Singh
2017-09-29 14:04 ` [dpdk-dev] [PATCH v5 5/5] app/testpmd: add traffic management forwarding mode Jasvinder Singh
2017-09-18 9:10 ` [dpdk-dev] [PATCH v4 3/4] net/softnic: add TM capabilities ops Jasvinder Singh
2017-09-25 2:33 ` Lu, Wenzhuo
2017-09-28 8:16 ` Singh, Jasvinder
2017-09-18 9:10 ` [dpdk-dev] [PATCH v4 4/4] net/softnic: add TM hierarchy related ops Jasvinder Singh
2017-09-25 7:14 ` Lu, Wenzhuo
2017-09-28 8:39 ` Singh, Jasvinder
2017-09-20 15:35 ` [dpdk-dev] [PATCH v4 0/4] net/softnic: sw fall-back pmd for traffic mgmt and others Thomas Monjalon
2017-09-22 22:07 ` Singh, Jasvinder
2017-10-06 10:40 ` Dumitrescu, Cristian
2017-10-06 12:13 ` Thomas Monjalon
2017-08-11 12:49 ` [dpdk-dev] [PATCH v3 2/4] net/softnic: add traffic management support Jasvinder Singh
2017-08-11 12:49 ` [dpdk-dev] [PATCH v3 3/4] net/softnic: add TM capabilities ops Jasvinder Singh
2017-08-11 12:49 ` [dpdk-dev] [PATCH v3 4/4] net/softnic: add TM hierarchy related ops Jasvinder Singh
2017-09-08 17:08 ` [dpdk-dev] [PATCH v3 0/4] net/softnic: sw fall-back pmd for traffic mgmt and others Dumitrescu, Cristian
2017-06-26 16:43 ` [dpdk-dev] [PATCH v2 2/2] net/softnic: add traffic management ops Jasvinder Singh
2017-05-26 18:11 ` [dpdk-dev] [PATCH " Jasvinder Singh
2017-06-07 14:32 ` [dpdk-dev] [PATCH 0/2] net/softnic: sw fall-back for traffic management Thomas Monjalon
2017-06-08 13:27 ` Dumitrescu, Cristian
2017-06-08 13:59 ` Thomas Monjalon
2017-06-08 15:27 ` Dumitrescu, Cristian
2017-06-08 16:16 ` Thomas Monjalon
2017-06-08 16:43 ` Dumitrescu, Cristian
2017-07-04 23:48 ` Thomas Monjalon
2017-07-05 9:32 ` Dumitrescu, Cristian
2017-07-05 10:17 ` Thomas Monjalon
2017-08-11 15:28 ` Stephen Hemminger
2017-08-11 16:22 ` Dumitrescu, Cristian
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=97795b7b-bfb4-f9da-b847-9b313916c374@intel.com \
--to=ferruh.yigit@intel.com \
--cc=cristian.dumitrescu@intel.com \
--cc=dev@dpdk.org \
--cc=jasvinder.singh@intel.com \
--cc=thomas@monjalon.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).