autotest system requirements.

autotest system requirements.

[Stephen Hemminger]

With 22.07 release, the test requirements seemed to have changed.
Can't run tests unless root now.

And the table test fails if only 1G of hugepages is setup.

This doesn't match the documentation:
https://doc.dpdk.org/guides/prog_guide/meson_ut.html

which shows running tests as non-root.

Re: autotest system requirements.

[Bruce Richardson]

On Tue, Jul 19, 2022 at 01:00:07PM -0700, Stephen Hemminger wrote:
> With 22.07 release, the test requirements seemed to have changed.
> Can't run tests unless root now.
> 
> And the table test fails if only 1G of hugepages is setup.
> 
> This doesn't match the documentation:
> https://doc.dpdk.org/guides/prog_guide/meson_ut.html
> 
> which shows running tests as non-root.

Can you clarify a bit more what you are seeing? I can certainly run a suite
of unit tests as non-root and have the majority of them pass. There are
failures and timeouts though, but I haven't root-caused why exactly.

/Bruce

$ meson test --suite DPDK:fast-tests
ninja: Entering directory `/home/bruce/dpdk.org/build'
ninja: no work to do.
  1/102 DPDK:fast-tests / acl_autotest                            OK              3.05s
  2/102 DPDK:fast-tests / atomic_autotest                         TIMEOUT        10.01s   killed by signal 15 SIGTERM
>>> DPDK_TEST=atomic_autotest MALLOC_PERTURB_=252 /home/bruce/dpdk.org/build/app/test/dpdk-test --file-prefix=atomic_autotest

[3/102] ð  3/102 DPDK:fast-tests / bitmap_autotest                         OK              0.14s
  4/102 DPDK:fast-tests / bpf_autotest                            OK              0.12s
  5/102 DPDK:fast-tests / bpf_convert_autotest                    OK              0.14s
...
100/102 DPDK:fast-tests / pdump_autotest                          OK              5.46s
101/102 DPDK:fast-tests / vdev_autotest                           OK              0.16s
102/102 DPDK:fast-tests / compressdev_autotest                    SKIP            0.15s   exit status 77

Ok:                 88  
Expected Fail:      0   
Fail:               1   
Unexpected Pass:    0   
Skipped:            5   
Timeout:            8   

Full log written to /home/bruce/dpdk.org/build/meson-logs/testlog.txt

Re: autotest system requirements.

[Stephen Hemminger]

On Wed, 20 Jul 2022 12:07:59 +0100
Bruce Richardson <bruce.richardson@intel.com> wrote:

> On Tue, Jul 19, 2022 at 01:00:07PM -0700, Stephen Hemminger wrote:
> > With 22.07 release, the test requirements seemed to have changed.
> > Can't run tests unless root now.
> > 
> > And the table test fails if only 1G of hugepages is setup.
> > 
> > This doesn't match the documentation:
> > https://doc.dpdk.org/guides/prog_guide/meson_ut.html
> > 
> > which shows running tests as non-root.  
> 
> Can you clarify a bit more what you are seeing? I can certainly run a suite
> of unit tests as non-root and have the majority of them pass. There are
> failures and timeouts though, but I haven't root-caused why exactly.
> 
> /Bruce
> 
> $ meson test --suite DPDK:fast-tests
> ninja: Entering directory `/home/bruce/dpdk.org/build'
> ninja: no work to do.
>   1/102 DPDK:fast-tests / acl_autotest                            OK              3.05s
>   2/102 DPDK:fast-tests / atomic_autotest                         TIMEOUT        10.01s   killed by signal 15 SIGTERM
> >>> DPDK_TEST=atomic_autotest MALLOC_PERTURB_=252 /home/bruce/dpdk.org/build/app/test/dpdk-test --file-prefix=atomic_autotest  
> 
> [3/102] ð  3/102 DPDK:fast-tests / bitmap_autotest                         OK              0.14s
>   4/102 DPDK:fast-tests / bpf_autotest                            OK              0.12s
>   5/102 DPDK:fast-tests / bpf_convert_autotest                    OK              0.14s
> ...
> 100/102 DPDK:fast-tests / pdump_autotest                          OK              5.46s
> 101/102 DPDK:fast-tests / vdev_autotest                           OK              0.16s
> 102/102 DPDK:fast-tests / compressdev_autotest                    SKIP            0.15s   exit status 77
> 
> Ok:                 88  
> Expected Fail:      0   
> Fail:               1   
> Unexpected Pass:    0   
> Skipped:            5   
> Timeout:            8   
> 
> Full log written to /home/bruce/dpdk.org/build/meson-logs/testlog.txt
> 

Turns out the default for hugepages setup is making it inaccessible.
Using new --user flag fixed that.

Probably should add that to docs about running tests.


With 1G of hugepages:

Ok:                 96  
Expected Fail:      0   
Fail:               1   
Unexpected Pass:    0   
Skipped:            5   
Timeout:            0