[dpdk-dev] [PATCH] doc: add known issue of rte abort on FreeBSD

[dpdk-dev] [PATCH] doc: add known issue of rte abort on FreeBSD

[Reshma Pattan]

Added known issue of rte_abort taking a long time
on FreeBSD due to recent memory subsystem rework.

Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
---
 doc/guides/rel_notes/release_18_05.rst | 15 +++++++++++++++
 1 file changed, 15 insertions(+)

diff --git a/doc/guides/rel_notes/release_18_05.rst b/doc/guides/rel_notes/release_18_05.rst
index 3dcb62538..c01781956 100644
--- a/doc/guides/rel_notes/release_18_05.rst
+++ b/doc/guides/rel_notes/release_18_05.rst
@@ -485,6 +485,21 @@ Known Issues
   dpdk-pdump example and any other applications using librte_pdump, cannot work
   with older version DPDK primary applications.
 
+* **rte_abort takes a long time on FreeBSD due to memory subsytsem rework.**
+
+  With the recent memory subsystem changes, DPDK processes now allocate a large
+  area of virtual memory address space. During rte_abort FreeBSD will dump the
+  contents of the whole reserved memory range, not just the used portion, to a
+  core dump file. Write this large core file can take a significant amount of
+  time, causing processes to appear hung on the system.
+
+  The work around for the issue is to set the system resource limits for core
+  dumps before running any tests e.g."limit coredumpsize 0". This will
+  effectively disable core dumps on FreeBSD. If they are not to be completely
+  disabled, a suitable limit, e.g. 1G might be specified instead of 0. This
+  needs to be run per-shell session, or before every test run. This change
+  can also be made persistent by adding "kern.coredump=0" to /etc/sysctl.conf
+
 
 Shared Library Versions
 -----------------------
-- 
2.14.3

Re: [dpdk-dev] [PATCH] doc: add known issue of rte abort on FreeBSD

[Burakov, Anatoly]

On 18-May-18 3:23 PM, Reshma Pattan wrote:
> Added known issue of rte_abort taking a long time
> on FreeBSD due to recent memory subsystem rework.
> 
> Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
> ---
>   doc/guides/rel_notes/release_18_05.rst | 15 +++++++++++++++
>   1 file changed, 15 insertions(+)
> 
> diff --git a/doc/guides/rel_notes/release_18_05.rst b/doc/guides/rel_notes/release_18_05.rst
> index 3dcb62538..c01781956 100644
> --- a/doc/guides/rel_notes/release_18_05.rst
> +++ b/doc/guides/rel_notes/release_18_05.rst
> @@ -485,6 +485,21 @@ Known Issues
>     dpdk-pdump example and any other applications using librte_pdump, cannot work
>     with older version DPDK primary applications.
>   
> +* **rte_abort takes a long time on FreeBSD due to memory subsytsem rework.**
> +
> +  With the recent memory subsystem changes, DPDK processes now allocate a large
> +  area of virtual memory address space. During rte_abort FreeBSD will dump the
> +  contents of the whole reserved memory range, not just the used portion, to a
> +  core dump file. Write this large core file can take a significant amount of
> +  time, causing processes to appear hung on the system.
> +
> +  The work around for the issue is to set the system resource limits for core
> +  dumps before running any tests e.g."limit coredumpsize 0". This will
> +  effectively disable core dumps on FreeBSD. If they are not to be completely
> +  disabled, a suitable limit, e.g. 1G might be specified instead of 0. This
> +  needs to be run per-shell session, or before every test run. This change
> +  can also be made persistent by adding "kern.coredump=0" to /etc/sysctl.conf
> +
>   
>   Shared Library Versions
>   -----------------------
> 

The explanation is slightly wrong.

The slowdown was there before memory rework - FreeBSD apparently dumps 
entire memory contents, including contigmem pages and anonymous pages. 
It's just that previously, we didn't preallocate so much memory, so it 
took ~5 seconds instead of minutes because it wasn't trying to dump 128 
gigabytes of VA space.

Otherwise,

Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>

-- 
Thanks,
Anatoly

[dpdk-dev] [PATCH v2] doc: add known issue of rte abort on FreeBSD

[Reshma Pattan]

Added known issue of rte_abort taking a long time
on FreeBSD due to recent memory subsystem rework.

Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>
---
v2: reworded.
---
 doc/guides/rel_notes/release_18_05.rst | 15 +++++++++++++++
 1 file changed, 15 insertions(+)

diff --git a/doc/guides/rel_notes/release_18_05.rst b/doc/guides/rel_notes/release_18_05.rst
index 3dcb62538..65014a284 100644
--- a/doc/guides/rel_notes/release_18_05.rst
+++ b/doc/guides/rel_notes/release_18_05.rst
@@ -485,6 +485,21 @@ Known Issues
   dpdk-pdump example and any other applications using librte_pdump, cannot work
   with older version DPDK primary applications.
 
+* **rte_abort takes a long time on FreeBSD.**
+
+  DPDK processes now allocates a large area of virtual memory address space,
+  with this change during rte_abort FreeBSD now dumps the contents of the
+  whole reserved memory range, not just the used portion, to a core dump file.
+  Write this large core file can take a significant amount of time, causing
+  processes to appear hung on the system.
+
+  The work around for the issue is to set the system resource limits for core
+  dumps before running any tests e.g."limit coredumpsize 0". This will
+  effectively disable core dumps on FreeBSD. If they are not to be completely
+  disabled, a suitable limit, e.g. 1G might be specified instead of 0. This
+  needs to be run per-shell session, or before every test run. This change
+  can also be made persistent by adding "kern.coredump=0" to /etc/sysctl.conf
+
 
 Shared Library Versions
 -----------------------
-- 
2.14.3

Re: [dpdk-dev] [PATCH v2] doc: add known issue of rte abort on FreeBSD

[Kovacevic, Marko]

> Added known issue of rte_abort taking a long time on FreeBSD due to recent
> memory subsystem rework.
> 
> Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
> Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>
> ---
> v2: reworded.
> ---
>  doc/guides/rel_notes/release_18_05.rst | 15 +++++++++++++++
>  1 file changed, 15 insertions(+)
> 
<...>

Acked-by: Marko Kovacevic <marko.kovacevic@intel.com>

Re: [dpdk-dev] [PATCH v2] doc: add known issue of rte abort on FreeBSD

[Mcnamara, John]

> -----Original Message-----
> From: Pattan, Reshma
> Sent: Monday, May 21, 2018 11:16 AM
> To: dev@dpdk.org
> Cc: Burakov, Anatoly <anatoly.burakov@intel.com>; Mcnamara, John
> <john.mcnamara@intel.com>; Pattan, Reshma <reshma.pattan@intel.com>
> Subject: [PATCH v2] doc: add known issue of rte abort on FreeBSD
> 
> Added known issue of rte_abort taking a long time on FreeBSD due to recent
> memory subsystem rework.
> 
> Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
> Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>

Could you open an Bugzilla defect for this and add it to the text.

Like this patch: http://dpdk.org/dev/patchwork/patch/40475/

Thanks,

John

[dpdk-dev] [PATCH v3] doc: add known issue of rte abort on FreeBSD

[Reshma Pattan]

Added known issue of rte_abort taking a long time
on FreeBSD due to recent memory subsystem rework.
Also, reference Bugzilla entry for keeping most
current information in one place.

Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>
---
v3: added bugzilla reference.
---
 doc/guides/rel_notes/release_18_05.rst | 16 ++++++++++++++++
 1 file changed, 16 insertions(+)

diff --git a/doc/guides/rel_notes/release_18_05.rst b/doc/guides/rel_notes/release_18_05.rst
index e8d74f507..4d3b00031 100644
--- a/doc/guides/rel_notes/release_18_05.rst
+++ b/doc/guides/rel_notes/release_18_05.rst
@@ -568,6 +568,22 @@ Known Issues
   dpdk-pdump example and any other applications using librte_pdump, cannot work
   with older version DPDK primary applications.
 
+* **rte_abort takes a long time on FreeBSD.**
+
+  DPDK processes now allocates a large area of virtual memory address space,
+  with this change during rte_abort FreeBSD now dumps the contents of the
+  whole reserved memory range, not just the used portion, to a core dump file.
+  Write this large core file can take a significant amount of time, causing
+  processes to appear hung on the system.
+
+  The work around for the issue is to set the system resource limits for core
+  dumps before running any tests e.g."limit coredumpsize 0". This will
+  effectively disable core dumps on FreeBSD. If they are not to be completely
+  disabled, a suitable limit, e.g. 1G might be specified instead of 0. This
+  needs to be run per-shell session, or before every test run. This change
+  can also be made persistent by adding "kern.coredump=0" to /etc/sysctl.conf
+
+  Bugzilla entry: https://dpdk.org/tracker/show_bug.cgi?id=53
 
 Shared Library Versions
 -----------------------
-- 
2.14.3

Re: [dpdk-dev] [PATCH v3] doc: add known issue of rte abort on FreeBSD

[Mcnamara, John]

> -----Original Message-----
> From: Pattan, Reshma
> Sent: Monday, May 28, 2018 4:40 PM
> To: dev@dpdk.org
> Cc: Burakov, Anatoly <anatoly.burakov@intel.com>; Mcnamara, John
> <john.mcnamara@intel.com>; Pattan, Reshma <reshma.pattan@intel.com>
> Subject: [PATCH v3] doc: add known issue of rte abort on FreeBSD
> 
> Added known issue of rte_abort taking a long time on FreeBSD due to recent
> memory subsystem rework.
> Also, reference Bugzilla entry for keeping most current information in one
> place.
> 
> Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
> Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>

Acked-by: John McNamara <john.mcnamara@intel.com>

Re: [dpdk-dev] [PATCH v3] doc: add known issue of rte abort on FreeBSD

[Thomas Monjalon]

> > Added known issue of rte_abort taking a long time on FreeBSD due to recent
> > memory subsystem rework.
> > Also, reference Bugzilla entry for keeping most current information in one
> > place.
> > 
> > Signed-off-by: Reshma Pattan <reshma.pattan@intel.com>
> > Acked-by: Anatoly Burakov <anatoly.burakov@intel.com>
> 
> Acked-by: John McNamara <john.mcnamara@intel.com>

Applied, thanks