Hello Jeremy,

On Mon, Mar 18, 2019 at 4:56 PM Jeremy Plsek <jplsek@iol.unh.edu> wrote:
Based on last weeks meeting, I've created a document to help start
documenting what test cases
should be worked on for cross platform support between NIC vendors and
which test cases can be used now in the Community Lab.

This list of test cases that should be worked on can be used when
discussing the budget with the board.

This also gives the Community Lab a list of tests that can be
implemented in the mean time.

https://docs.google.com/document/d/1WbRoIq0f5SmHM6D5sLbeh7hxRJdE2ppwB5JECHllLjg/edit?usp=sharing
(This document is publicly editable. If I notice the document changes
outside the scope of the goal, I'll try to revert it and give
individual access instead.)

If creating this list over email is wanted instead, then we can do it
in this thread instead of the document. (And I'll update the document
as emails come in.)

Well, for now, I prefer emails because I did not follow the CI discussions so far and I might be off topic.

Here I go, the list is large, I tried to write from the basic to the most advanced/less used.

- Non regression tests on basic startup (we can reuse the dpdk ut and/or enhance them), this part would be hw agnostic:
  - core checks: playing with cpus online/offline + dpdk coremask/list + checking cpu affinity of all dpdk threads
  - memory checks: a big topic because we have multiple modes at the moment
  - startup devices blacklist/whitelist
  - hotplug (unplug) of devices

- Non regression tests on eth drivers (testpmd seems the best candidate), this must be ran against a lot of nics/drivers:
  - reception of unicast packets: check that we receive packets for primary and secondary addresses (and only for them, meaning with checks that undesired packets are dropped following updates)
  - promisc support
  - idem with multicast packets
  - link status checks
  - rte_eth_link_up/down checks
  - mtu checks
  - rss checks
  - ptypes classification
  - stats checks
  - rte_flow checks
  - port restart checks + associated configuration persistency
  - flow control
  - rx/tx offloads
  - rx/tx descriptor status


--
David Marchand