tests: add generalized tags for tests, use them for run-solo tests 63/30763/12
authorAndrew Yourtchenko <ayourtch@gmail.com>
Thu, 14 Jan 2021 10:19:08 +0000 (10:19 +0000)
committerAndrew Yourtchenko <ayourtch@gmail.com>
Fri, 22 Jan 2021 15:35:11 +0000 (15:35 +0000)
commit06f328129a01276858fff1086215478fa106dd8e
tree6d6c0091b4145466fdfeb8fbe6616ff1f09b4d08
parentb8f6122b4f4c828dee103d1f3116d27e6e3e6f3a
tests: add generalized tags for tests, use them for run-solo tests

We have accumulated several scenarios in prod or wishlists
where it would be useful to have a general infra to say yes/no
about a certain test, and potentially make decisions based on that,
for example:

- runs solo (aka 'time-dependent')
- (wishlist) part of quick smoke-test set
- (wishlist) intermittent failure unrelated to timing
- (wishlist) test broken with a multi-worker config in vpp

Refactor the current "run-solo" code to allow for this extension.

Type: test

Change-Id: Ia5b3810e57c0543753c8e0dc4dc0cfb4a30b36ac
Signed-off-by: Andrew Yourtchenko <ayourtch@gmail.com>
Signed-off-by: Klement Sekera <ksekera@cisco.com>
src/plugins/dhcp/test/test_dhcp.py
src/plugins/dhcp/test/test_dhcp6.py
src/plugins/flowprobe/test/test_flowprobe.py
src/plugins/memif/test/test_memif.py
src/vnet/bfd/test/test_bfd.py
test/framework.py
test/run_tests.py
test/test_ip6.py
test/test_session.py
test/test_util.py