DPDK patches and discussions
 help / color / mirror / Atom feed
* [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
@ 2021-09-03 16:15 Stephen Hemminger
  2021-09-15  8:19 ` [dpdk-dev] [dpdk-stable] " Ferruh Yigit
  2021-09-20 13:23 ` [dpdk-dev] " Loftus, Ciara
  0 siblings, 2 replies; 8+ messages in thread
From: Stephen Hemminger @ 2021-09-03 16:15 UTC (permalink / raw)
  To: dev; +Cc: Stephen Hemminger, stable, xiaolong.ye

Doing basic operations like info_get or get_stats was broken
in af_xdp PMD. The info_get would crash because dev->device
was NULL in secondary process. Fix this by doing same initialization
as af_packet and tap devices.

The get_stats would crash because the XDP socket is not open in
primary process. As a workaround don't query kernel for dropped
packets when called from secondary process.

Note: this does not address the other bug which is that transmitting
in secondary process is broken because the send() in tx_kick
will fail because XDP socket fd is not valid in secondary process.

Bugzilla ID: 805
Fixes: f1debd77efaf ("net/af_xdp: introduce AF_XDP PMD")
Cc: stable@dpdk.org
Cc: xiaolong.ye@intel.com
Ciara Loftus <ciara.loftus@intel.com>
Qi Zhang <qi.z.zhang@intel.com>
Anatoly Burakov <anatoly.burakov@intel.com>

Signed-off-by: Stephen Hemminger <stephen@networkplumber.org>
---
 drivers/net/af_xdp/rte_eth_af_xdp.c | 17 +++++++++--------
 1 file changed, 9 insertions(+), 8 deletions(-)

diff --git a/drivers/net/af_xdp/rte_eth_af_xdp.c b/drivers/net/af_xdp/rte_eth_af_xdp.c
index 74ffa4511284..70abc14fa753 100644
--- a/drivers/net/af_xdp/rte_eth_af_xdp.c
+++ b/drivers/net/af_xdp/rte_eth_af_xdp.c
@@ -860,7 +860,7 @@ eth_stats_get(struct rte_eth_dev *dev, struct rte_eth_stats *stats)
 	struct pkt_rx_queue *rxq;
 	struct pkt_tx_queue *txq;
 	socklen_t optlen;
-	int i, ret;
+	int i;
 
 	for (i = 0; i < dev->data->nb_rx_queues; i++) {
 		optlen = sizeof(struct xdp_statistics);
@@ -876,13 +876,12 @@ eth_stats_get(struct rte_eth_dev *dev, struct rte_eth_stats *stats)
 		stats->ibytes += stats->q_ibytes[i];
 		stats->imissed += rxq->stats.rx_dropped;
 		stats->oerrors += txq->stats.tx_dropped;
-		ret = getsockopt(xsk_socket__fd(rxq->xsk), SOL_XDP,
-				XDP_STATISTICS, &xdp_stats, &optlen);
-		if (ret != 0) {
-			AF_XDP_LOG(ERR, "getsockopt() failed for XDP_STATISTICS.\n");
-			return -1;
-		}
-		stats->imissed += xdp_stats.rx_dropped;
+
+		/* The socket fd is not valid in secondary process */
+		if (rte_eal_process_type() != RTE_PROC_SECONDARY &&
+		    getsockopt(xsk_socket__fd(rxq->xsk), SOL_XDP,
+			       XDP_STATISTICS, &xdp_stats, &optlen) == 0)
+			stats->imissed += xdp_stats.rx_dropped;
 
 		stats->opackets += stats->q_opackets[i];
 		stats->obytes += stats->q_obytes[i];
@@ -1799,7 +1798,9 @@ rte_pmd_af_xdp_probe(struct rte_vdev_device *dev)
 			AF_XDP_LOG(ERR, "Failed to probe %s\n", name);
 			return -EINVAL;
 		}
+		/* TODO: reconnect socket from primary */
 		eth_dev->dev_ops = &ops;
+		eth_dev->device = &dev->device;
 		rte_eth_dev_probing_finish(eth_dev);
 		return 0;
 	}
-- 
2.30.2


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [dpdk-stable] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-03 16:15 [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process Stephen Hemminger
@ 2021-09-15  8:19 ` Ferruh Yigit
  2021-09-20 13:23 ` [dpdk-dev] " Loftus, Ciara
  1 sibling, 0 replies; 8+ messages in thread
From: Ferruh Yigit @ 2021-09-15  8:19 UTC (permalink / raw)
  To: Stephen Hemminger, dev
  Cc: stable, xiaolong.ye, Loftus, Ciara, Qi Zhang, Anatoly Burakov

On 9/3/2021 5:15 PM, Stephen Hemminger wrote:
> Doing basic operations like info_get or get_stats was broken
> in af_xdp PMD. The info_get would crash because dev->device
> was NULL in secondary process. Fix this by doing same initialization
> as af_packet and tap devices.
> 
> The get_stats would crash because the XDP socket is not open in
> primary process. As a workaround don't query kernel for dropped
> packets when called from secondary process.
> 
> Note: this does not address the other bug which is that transmitting
> in secondary process is broken because the send() in tx_kick
> will fail because XDP socket fd is not valid in secondary process.
> 
> Bugzilla ID: 805
> Fixes: f1debd77efaf ("net/af_xdp: introduce AF_XDP PMD")
> Cc: stable@dpdk.org
> Cc: xiaolong.ye@intel.com
> Ciara Loftus <ciara.loftus@intel.com>
> Qi Zhang <qi.z.zhang@intel.com>
> Anatoly Burakov <anatoly.burakov@intel.com>
> 

+cc Ciara, Qi & Anatoly

> Signed-off-by: Stephen Hemminger <stephen@networkplumber.org>
> ---
>  drivers/net/af_xdp/rte_eth_af_xdp.c | 17 +++++++++--------
>  1 file changed, 9 insertions(+), 8 deletions(-)
> 
> diff --git a/drivers/net/af_xdp/rte_eth_af_xdp.c b/drivers/net/af_xdp/rte_eth_af_xdp.c
> index 74ffa4511284..70abc14fa753 100644
> --- a/drivers/net/af_xdp/rte_eth_af_xdp.c
> +++ b/drivers/net/af_xdp/rte_eth_af_xdp.c
> @@ -860,7 +860,7 @@ eth_stats_get(struct rte_eth_dev *dev, struct rte_eth_stats *stats)
>  	struct pkt_rx_queue *rxq;
>  	struct pkt_tx_queue *txq;
>  	socklen_t optlen;
> -	int i, ret;
> +	int i;
>  
>  	for (i = 0; i < dev->data->nb_rx_queues; i++) {
>  		optlen = sizeof(struct xdp_statistics);
> @@ -876,13 +876,12 @@ eth_stats_get(struct rte_eth_dev *dev, struct rte_eth_stats *stats)
>  		stats->ibytes += stats->q_ibytes[i];
>  		stats->imissed += rxq->stats.rx_dropped;
>  		stats->oerrors += txq->stats.tx_dropped;
> -		ret = getsockopt(xsk_socket__fd(rxq->xsk), SOL_XDP,
> -				XDP_STATISTICS, &xdp_stats, &optlen);
> -		if (ret != 0) {
> -			AF_XDP_LOG(ERR, "getsockopt() failed for XDP_STATISTICS.\n");
> -			return -1;
> -		}
> -		stats->imissed += xdp_stats.rx_dropped;
> +
> +		/* The socket fd is not valid in secondary process */
> +		if (rte_eal_process_type() != RTE_PROC_SECONDARY &&
> +		    getsockopt(xsk_socket__fd(rxq->xsk), SOL_XDP,
> +			       XDP_STATISTICS, &xdp_stats, &optlen) == 0)
> +			stats->imissed += xdp_stats.rx_dropped;
>  
>  		stats->opackets += stats->q_opackets[i];
>  		stats->obytes += stats->q_obytes[i];
> @@ -1799,7 +1798,9 @@ rte_pmd_af_xdp_probe(struct rte_vdev_device *dev)
>  			AF_XDP_LOG(ERR, "Failed to probe %s\n", name);
>  			return -EINVAL;
>  		}
> +		/* TODO: reconnect socket from primary */
>  		eth_dev->dev_ops = &ops;
> +		eth_dev->device = &dev->device;
>  		rte_eth_dev_probing_finish(eth_dev);
>  		return 0;
>  	}
> 


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-03 16:15 [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process Stephen Hemminger
  2021-09-15  8:19 ` [dpdk-dev] [dpdk-stable] " Ferruh Yigit
@ 2021-09-20 13:23 ` Loftus, Ciara
  2021-09-20 14:43   ` Stephen Hemminger
  1 sibling, 1 reply; 8+ messages in thread
From: Loftus, Ciara @ 2021-09-20 13:23 UTC (permalink / raw)
  To: Stephen Hemminger, dev
  Cc: stable, Yigit, Ferruh, Zhang, Qi Z, Burakov, Anatoly



> -----Original Message-----
> From: dev <dev-bounces@dpdk.org> On Behalf Of Stephen Hemminger
> Sent: Friday 3 September 2021 17:15
> To: dev@dpdk.org
> Cc: Stephen Hemminger <stephen@networkplumber.org>;
> stable@dpdk.org; xiaolong.ye@intel.com
> Subject: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
> 
> Doing basic operations like info_get or get_stats was broken
> in af_xdp PMD. The info_get would crash because dev->device
> was NULL in secondary process. Fix this by doing same initialization
> as af_packet and tap devices.
> 
> The get_stats would crash because the XDP socket is not open in
> primary process. As a workaround don't query kernel for dropped
> packets when called from secondary process.
> 
> Note: this does not address the other bug which is that transmitting
> in secondary process is broken because the send() in tx_kick
> will fail because XDP socket fd is not valid in secondary process.

Hi Stephen,

Apologies for the delayed reply, I was on vacation.

In the Bugzilla report you suggest we:
"mark AF_XDP as broken in with primary/secondary
and return an error in probe in secondary process".
I agree with this suggestion. However with this patch we still permit secondary, and just make sure it doesn't crash for get_stats. Did you change your mind?
Personally, I would prefer to have primary/secondary either working 100% or else not allowed at all by throwing an error during probe. What do you think? Do you have a reason/use case to permit secondary processes despite some features not being available eg. full stats, tx?

Thanks,
Ciara

> 
> Bugzilla ID: 805
> Fixes: f1debd77efaf ("net/af_xdp: introduce AF_XDP PMD")
> Cc: stable@dpdk.org
> Cc: xiaolong.ye@intel.com
> Ciara Loftus <ciara.loftus@intel.com>
> Qi Zhang <qi.z.zhang@intel.com>
> Anatoly Burakov <anatoly.burakov@intel.com>
> 
> Signed-off-by: Stephen Hemminger <stephen@networkplumber.org>
> ---
>  drivers/net/af_xdp/rte_eth_af_xdp.c | 17 +++++++++--------
>  1 file changed, 9 insertions(+), 8 deletions(-)
> 
> diff --git a/drivers/net/af_xdp/rte_eth_af_xdp.c
> b/drivers/net/af_xdp/rte_eth_af_xdp.c
> index 74ffa4511284..70abc14fa753 100644
> --- a/drivers/net/af_xdp/rte_eth_af_xdp.c
> +++ b/drivers/net/af_xdp/rte_eth_af_xdp.c
> @@ -860,7 +860,7 @@ eth_stats_get(struct rte_eth_dev *dev, struct
> rte_eth_stats *stats)
>  	struct pkt_rx_queue *rxq;
>  	struct pkt_tx_queue *txq;
>  	socklen_t optlen;
> -	int i, ret;
> +	int i;
> 
>  	for (i = 0; i < dev->data->nb_rx_queues; i++) {
>  		optlen = sizeof(struct xdp_statistics);
> @@ -876,13 +876,12 @@ eth_stats_get(struct rte_eth_dev *dev, struct
> rte_eth_stats *stats)
>  		stats->ibytes += stats->q_ibytes[i];
>  		stats->imissed += rxq->stats.rx_dropped;
>  		stats->oerrors += txq->stats.tx_dropped;
> -		ret = getsockopt(xsk_socket__fd(rxq->xsk), SOL_XDP,
> -				XDP_STATISTICS, &xdp_stats, &optlen);
> -		if (ret != 0) {
> -			AF_XDP_LOG(ERR, "getsockopt() failed for
> XDP_STATISTICS.\n");
> -			return -1;
> -		}
> -		stats->imissed += xdp_stats.rx_dropped;
> +
> +		/* The socket fd is not valid in secondary process */
> +		if (rte_eal_process_type() != RTE_PROC_SECONDARY &&
> +		    getsockopt(xsk_socket__fd(rxq->xsk), SOL_XDP,
> +			       XDP_STATISTICS, &xdp_stats, &optlen) == 0)
> +			stats->imissed += xdp_stats.rx_dropped;
> 
>  		stats->opackets += stats->q_opackets[i];
>  		stats->obytes += stats->q_obytes[i];
> @@ -1799,7 +1798,9 @@ rte_pmd_af_xdp_probe(struct rte_vdev_device
> *dev)
>  			AF_XDP_LOG(ERR, "Failed to probe %s\n", name);
>  			return -EINVAL;
>  		}
> +		/* TODO: reconnect socket from primary */
>  		eth_dev->dev_ops = &ops;
> +		eth_dev->device = &dev->device;
>  		rte_eth_dev_probing_finish(eth_dev);
>  		return 0;
>  	}
> --
> 2.30.2


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-20 13:23 ` [dpdk-dev] " Loftus, Ciara
@ 2021-09-20 14:43   ` Stephen Hemminger
  2021-09-20 15:09     ` Loftus, Ciara
  0 siblings, 1 reply; 8+ messages in thread
From: Stephen Hemminger @ 2021-09-20 14:43 UTC (permalink / raw)
  To: Loftus, Ciara; +Cc: dev, stable, Yigit, Ferruh, Zhang, Qi Z, Burakov, Anatoly

On Mon, 20 Sep 2021 13:23:57 +0000
"Loftus, Ciara" <ciara.loftus@intel.com> wrote:

> > -----Original Message-----
> > From: dev <dev-bounces@dpdk.org> On Behalf Of Stephen Hemminger
> > Sent: Friday 3 September 2021 17:15
> > To: dev@dpdk.org
> > Cc: Stephen Hemminger <stephen@networkplumber.org>;
> > stable@dpdk.org; xiaolong.ye@intel.com
> > Subject: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
> > 
> > Doing basic operations like info_get or get_stats was broken
> > in af_xdp PMD. The info_get would crash because dev->device
> > was NULL in secondary process. Fix this by doing same initialization
> > as af_packet and tap devices.
> > 
> > The get_stats would crash because the XDP socket is not open in
> > primary process. As a workaround don't query kernel for dropped
> > packets when called from secondary process.
> > 
> > Note: this does not address the other bug which is that transmitting
> > in secondary process is broken because the send() in tx_kick
> > will fail because XDP socket fd is not valid in secondary process.  
> 
> Hi Stephen,
> 
> Apologies for the delayed reply, I was on vacation.
> 
> In the Bugzilla report you suggest we:
> "mark AF_XDP as broken in with primary/secondary
> and return an error in probe in secondary process".
> I agree with this suggestion. However with this patch we still permit secondary, and just make sure it doesn't crash for get_stats. Did you change your mind?
> Personally, I would prefer to have primary/secondary either working 100% or else not allowed at all by throwing an error during probe. What do you think? Do you have a reason/use case to permit secondary processes despite some features not being available eg. full stats, tx?
> 
> Thanks,
> Ciara

There are two cases where secondary is useful even if send/receive can't work from secondary process.
The pdump and proc-info applications can work with these patches.

I am using XDP over pdump as an easy way to get packets into the code for testing.

The flag in the documentation doesn't have a "limited" version.
If you want, will send another patch to disable secondary support.

Supporting secondary, means adding a mechanism to pass the socket around.


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-20 14:43   ` Stephen Hemminger
@ 2021-09-20 15:09     ` Loftus, Ciara
  2021-09-21 17:45       ` Stephen Hemminger
  0 siblings, 1 reply; 8+ messages in thread
From: Loftus, Ciara @ 2021-09-20 15:09 UTC (permalink / raw)
  To: Stephen Hemminger
  Cc: dev, stable, Yigit, Ferruh, Zhang, Qi Z, Burakov, Anatoly

> 
> On Mon, 20 Sep 2021 13:23:57 +0000
> "Loftus, Ciara" <ciara.loftus@intel.com> wrote:
> 
> > > -----Original Message-----
> > > From: dev <dev-bounces@dpdk.org> On Behalf Of Stephen Hemminger
> > > Sent: Friday 3 September 2021 17:15
> > > To: dev@dpdk.org
> > > Cc: Stephen Hemminger <stephen@networkplumber.org>;
> > > stable@dpdk.org; xiaolong.ye@intel.com
> > > Subject: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary
> process
> > >
> > > Doing basic operations like info_get or get_stats was broken
> > > in af_xdp PMD. The info_get would crash because dev->device
> > > was NULL in secondary process. Fix this by doing same initialization
> > > as af_packet and tap devices.
> > >
> > > The get_stats would crash because the XDP socket is not open in
> > > primary process. As a workaround don't query kernel for dropped
> > > packets when called from secondary process.
> > >
> > > Note: this does not address the other bug which is that transmitting
> > > in secondary process is broken because the send() in tx_kick
> > > will fail because XDP socket fd is not valid in secondary process.
> >
> > Hi Stephen,
> >
> > Apologies for the delayed reply, I was on vacation.
> >
> > In the Bugzilla report you suggest we:
> > "mark AF_XDP as broken in with primary/secondary
> > and return an error in probe in secondary process".
> > I agree with this suggestion. However with this patch we still permit
> secondary, and just make sure it doesn't crash for get_stats. Did you change
> your mind?
> > Personally, I would prefer to have primary/secondary either working 100%
> or else not allowed at all by throwing an error during probe. What do you
> think? Do you have a reason/use case to permit secondary processes despite
> some features not being available eg. full stats, tx?
> >
> > Thanks,
> > Ciara
> 
> There are two cases where secondary is useful even if send/receive can't
> work from secondary process.
> The pdump and proc-info applications can work with these patches.
> 
> I am using XDP over pdump as an easy way to get packets into the code for
> testing.
> 
> The flag in the documentation doesn't have a "limited" version.
> If you want, will send another patch to disable secondary support.

Thanks for explaining. Since there are use cases for secondary, even if the functionality is limited, I don't think it should be disabled.
Since we can't flag it as 'limited' in the feature matrix, could you please add a note about the send/receive limitation in the AF_XDP PMD documentation in a v2? There are already a number of limitations listed, which you can add to.

Thanks,
Ciara

> 
> Supporting secondary, means adding a mechanism to pass the socket
> around.

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-20 15:09     ` Loftus, Ciara
@ 2021-09-21 17:45       ` Stephen Hemminger
  2021-09-23 12:33         ` Loftus, Ciara
  0 siblings, 1 reply; 8+ messages in thread
From: Stephen Hemminger @ 2021-09-21 17:45 UTC (permalink / raw)
  To: Loftus, Ciara; +Cc: dev, stable, Yigit, Ferruh, Zhang, Qi Z, Burakov, Anatoly

On Mon, 20 Sep 2021 15:09:36 +0000
"Loftus, Ciara" <ciara.loftus@intel.com> wrote:

> > 
> > On Mon, 20 Sep 2021 13:23:57 +0000
> > "Loftus, Ciara" <ciara.loftus@intel.com> wrote:
> >   
> > > > -----Original Message-----
> > > > From: dev <dev-bounces@dpdk.org> On Behalf Of Stephen Hemminger
> > > > Sent: Friday 3 September 2021 17:15
> > > > To: dev@dpdk.org
> > > > Cc: Stephen Hemminger <stephen@networkplumber.org>;
> > > > stable@dpdk.org; xiaolong.ye@intel.com
> > > > Subject: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary  
> > process  
> > > >
> > > > Doing basic operations like info_get or get_stats was broken
> > > > in af_xdp PMD. The info_get would crash because dev->device
> > > > was NULL in secondary process. Fix this by doing same initialization
> > > > as af_packet and tap devices.
> > > >
> > > > The get_stats would crash because the XDP socket is not open in
> > > > primary process. As a workaround don't query kernel for dropped
> > > > packets when called from secondary process.
> > > >
> > > > Note: this does not address the other bug which is that transmitting
> > > > in secondary process is broken because the send() in tx_kick
> > > > will fail because XDP socket fd is not valid in secondary process.  
> > >
> > > Hi Stephen,
> > >
> > > Apologies for the delayed reply, I was on vacation.
> > >
> > > In the Bugzilla report you suggest we:
> > > "mark AF_XDP as broken in with primary/secondary
> > > and return an error in probe in secondary process".
> > > I agree with this suggestion. However with this patch we still permit  
> > secondary, and just make sure it doesn't crash for get_stats. Did you change
> > your mind?  
> > > Personally, I would prefer to have primary/secondary either working 100%  
> > or else not allowed at all by throwing an error during probe. What do you
> > think? Do you have a reason/use case to permit secondary processes despite
> > some features not being available eg. full stats, tx?  
> > >
> > > Thanks,
> > > Ciara  
> > 
> > There are two cases where secondary is useful even if send/receive can't
> > work from secondary process.
> > The pdump and proc-info applications can work with these patches.
> > 
> > I am using XDP over pdump as an easy way to get packets into the code for
> > testing.
> > 
> > The flag in the documentation doesn't have a "limited" version.
> > If you want, will send another patch to disable secondary support.  
> 
> Thanks for explaining. Since there are use cases for secondary, even if the functionality is limited, I don't think it should be disabled.
> Since we can't flag it as 'limited' in the feature matrix, could you please add a note about the send/receive limitation in the AF_XDP PMD documentation in a v2? There are already a number of limitations listed, which you can add to.
> 
> Thanks,
> Ciara
> 
> > 
> > Supporting secondary, means adding a mechanism to pass the socket
> > around.  

Looking at this in more detail, and my recommendation is:
For 21.11 release (and mark it as Fixes so it gets backported). Have the driver
return -ENOTSUP in secondary process.

For 22.03 add real secondary support using the rte_mp_msg to pass necessary
state to secondary process. Includes socket (and other memory regions?).

The pdump and proc-info cases are only useful for developer testing, and there are
other ways to do the same thing.

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-21 17:45       ` Stephen Hemminger
@ 2021-09-23 12:33         ` Loftus, Ciara
  2021-10-05 15:02           ` Ferruh Yigit
  0 siblings, 1 reply; 8+ messages in thread
From: Loftus, Ciara @ 2021-09-23 12:33 UTC (permalink / raw)
  To: Stephen Hemminger
  Cc: dev, stable, Yigit, Ferruh, Zhang, Qi Z, Burakov, Anatoly

> > > > >
> > > > > Doing basic operations like info_get or get_stats was broken
> > > > > in af_xdp PMD. The info_get would crash because dev->device
> > > > > was NULL in secondary process. Fix this by doing same initialization
> > > > > as af_packet and tap devices.
> > > > >
> > > > > The get_stats would crash because the XDP socket is not open in
> > > > > primary process. As a workaround don't query kernel for dropped
> > > > > packets when called from secondary process.
> > > > >
> > > > > Note: this does not address the other bug which is that transmitting
> > > > > in secondary process is broken because the send() in tx_kick
> > > > > will fail because XDP socket fd is not valid in secondary process.
> > > >
> > > > Hi Stephen,
> > > >
> > > > Apologies for the delayed reply, I was on vacation.
> > > >
> > > > In the Bugzilla report you suggest we:
> > > > "mark AF_XDP as broken in with primary/secondary
> > > > and return an error in probe in secondary process".
> > > > I agree with this suggestion. However with this patch we still permit
> > > secondary, and just make sure it doesn't crash for get_stats. Did you
> change
> > > your mind?
> > > > Personally, I would prefer to have primary/secondary either working
> 100%
> > > or else not allowed at all by throwing an error during probe. What do you
> > > think? Do you have a reason/use case to permit secondary processes
> despite
> > > some features not being available eg. full stats, tx?
> > > >
> > > > Thanks,
> > > > Ciara
> > >
> > > There are two cases where secondary is useful even if send/receive can't
> > > work from secondary process.
> > > The pdump and proc-info applications can work with these patches.
> > >
> > > I am using XDP over pdump as an easy way to get packets into the code
> for
> > > testing.
> > >
> > > The flag in the documentation doesn't have a "limited" version.
> > > If you want, will send another patch to disable secondary support.
> >
> > Thanks for explaining. Since there are use cases for secondary, even if the
> functionality is limited, I don't think it should be disabled.
> > Since we can't flag it as 'limited' in the feature matrix, could you please add
> a note about the send/receive limitation in the AF_XDP PMD documentation
> in a v2? There are already a number of limitations listed, which you can add
> to.
> >
> > Thanks,
> > Ciara
> >
> > >
> > > Supporting secondary, means adding a mechanism to pass the socket
> > > around.
> 
> Looking at this in more detail, and my recommendation is:
> For 21.11 release (and mark it as Fixes so it gets backported). Have the driver
> return -ENOTSUP in secondary process.
> 
> For 22.03 add real secondary support using the rte_mp_msg to pass
> necessary
> state to secondary process. Includes socket (and other memory regions?).
> 
> The pdump and proc-info cases are only useful for developer testing, and
> there are
> other ways to do the same thing.


+1 that sounds reasonable to me.

Thanks,
Ciara

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process
  2021-09-23 12:33         ` Loftus, Ciara
@ 2021-10-05 15:02           ` Ferruh Yigit
  0 siblings, 0 replies; 8+ messages in thread
From: Ferruh Yigit @ 2021-10-05 15:02 UTC (permalink / raw)
  To: Loftus, Ciara, Stephen Hemminger
  Cc: dev, stable, Zhang, Qi Z, Burakov, Anatoly

On 9/23/2021 1:33 PM, Loftus, Ciara wrote:
>>>>>>
>>>>>> Doing basic operations like info_get or get_stats was broken
>>>>>> in af_xdp PMD. The info_get would crash because dev->device
>>>>>> was NULL in secondary process. Fix this by doing same initialization
>>>>>> as af_packet and tap devices.
>>>>>>
>>>>>> The get_stats would crash because the XDP socket is not open in
>>>>>> primary process. As a workaround don't query kernel for dropped
>>>>>> packets when called from secondary process.
>>>>>>
>>>>>> Note: this does not address the other bug which is that transmitting
>>>>>> in secondary process is broken because the send() in tx_kick
>>>>>> will fail because XDP socket fd is not valid in secondary process.
>>>>>
>>>>> Hi Stephen,
>>>>>
>>>>> Apologies for the delayed reply, I was on vacation.
>>>>>
>>>>> In the Bugzilla report you suggest we:
>>>>> "mark AF_XDP as broken in with primary/secondary
>>>>> and return an error in probe in secondary process".
>>>>> I agree with this suggestion. However with this patch we still permit
>>>> secondary, and just make sure it doesn't crash for get_stats. Did you
>> change
>>>> your mind?
>>>>> Personally, I would prefer to have primary/secondary either working
>> 100%
>>>> or else not allowed at all by throwing an error during probe. What do you
>>>> think? Do you have a reason/use case to permit secondary processes
>> despite
>>>> some features not being available eg. full stats, tx?
>>>>>
>>>>> Thanks,
>>>>> Ciara
>>>>
>>>> There are two cases where secondary is useful even if send/receive can't
>>>> work from secondary process.
>>>> The pdump and proc-info applications can work with these patches.
>>>>
>>>> I am using XDP over pdump as an easy way to get packets into the code
>> for
>>>> testing.
>>>>
>>>> The flag in the documentation doesn't have a "limited" version.
>>>> If you want, will send another patch to disable secondary support.
>>>
>>> Thanks for explaining. Since there are use cases for secondary, even if the
>> functionality is limited, I don't think it should be disabled.
>>> Since we can't flag it as 'limited' in the feature matrix, could you please add
>> a note about the send/receive limitation in the AF_XDP PMD documentation
>> in a v2? There are already a number of limitations listed, which you can add
>> to.
>>>
>>> Thanks,
>>> Ciara
>>>
>>>>
>>>> Supporting secondary, means adding a mechanism to pass the socket
>>>> around.
>>
>> Looking at this in more detail, and my recommendation is:
>> For 21.11 release (and mark it as Fixes so it gets backported). Have the driver
>> return -ENOTSUP in secondary process.
>>
>> For 22.03 add real secondary support using the rte_mp_msg to pass
>> necessary
>> state to secondary process. Includes socket (and other memory regions?).
>>
>> The pdump and proc-info cases are only useful for developer testing, and
>> there are
>> other ways to do the same thing.
> 
> 
> +1 that sounds reasonable to me.
> 

This patch superseded by following which disables the secondary process support:
https://patches.dpdk.org/project/dpdk/patch/20210930134604.32585-1-ciara.loftus@intel.com/


^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2021-10-05 15:04 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-09-03 16:15 [dpdk-dev] [PATCH] net/af_xdp: fix support of secondary process Stephen Hemminger
2021-09-15  8:19 ` [dpdk-dev] [dpdk-stable] " Ferruh Yigit
2021-09-20 13:23 ` [dpdk-dev] " Loftus, Ciara
2021-09-20 14:43   ` Stephen Hemminger
2021-09-20 15:09     ` Loftus, Ciara
2021-09-21 17:45       ` Stephen Hemminger
2021-09-23 12:33         ` Loftus, Ciara
2021-10-05 15:02           ` Ferruh Yigit

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).