CSIT-1469: Migrate IPsecUtil library from VAT to PAPI

Change-Id: Iac790bf5755a70697e4c4eff32242b04f8e7f789
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Use PapiSocketProvider for most PAPI calls

Ticket: CSIT-1541
Ticket: VPP-1722
Ticket: CSIT-1546

+ Increase timeout to hide x520 slownes of show hardware detail.
- Install sshpass and update ssh client in virl bootstrap.
 + Added TODOs to remove when CSIT-1546 is fixed.
+ Enable default socksvr on any startup conf.
+ Improve OptionString init and repr.
- The non-socket executor still kept for stats.
 + Remove everything unrelated to stats from non-socket executor.
- Remove some debug-loooking calls to avoid failures.
  TODO: Introduce proper parsing to the affected keywords.
+ Reduce logging from PAPI code to level INFO.
 - Needs https://gerrit.fd.io/r/20660 to fully work.
+ Change default values for LocalExecution.run()
 + Return code check enabled by default.
   Code is more readable when rc!=0 is allowed explicitly,
   and the test code will now detect unexpected failures.
 + Logging disabled by default.
   Output XML is large already. Important logging can be enabled explicitly.
+ Restore alphabetical order in common.sh functions.

Change-Id: I05882cb6b620ad14638f7404b5ad38c7a5de9e6c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Refactor VPP Device VM vhost tests

* replace the current VM image with kernel img
* rework keyword usage to make it consistent with performance tests
* remove resources/libraries/robot/shared/qemu.robot as it's not used
  anywhere anymore

Change-Id: Ia5bc19e9e6ed9af031e4d9b5c0c89431fb49fd33
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

FIX: Move per-patch building mechanics

- Use make pkg-verify

Change-Id: Id0f95c9261f1a1b5fa017b0823f87aeb5d6bb6d1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

fix invalid variable name issue of ipsechw test suites

Change-Id: Ie7bfaaaa2e4cab4b52dab42f71780f581306659b
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~663-g692b949~b7537

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~663-g692b9498e

 - use new vpp ref build - centos7:
   19.08-rc0~663_g692b949~b7410

Change-Id: Ia80895a0a679b23ac5cbcd540ba9fda02d1868e9
Signed-off-by: Jan Gelety <jgelety@cisco.com>

VPPD: Cop, iACL, Policer

- Alignment with PERF

Change-Id: Id7b2cb91c88e44cf9265c3376330f6aa579abf7a
Signed-off-by: Peter Mikus <pmikus@cisco.com>

PapiExecutor always verifies

Do not support returning unverified replies anymore.
Basically, ".get_replies().verify_replies()" is now just ".get_replies()".
This allows fairly large simplifications both at call sites
and in PapiExecutor.py

+ Rename get_dumps to get_details.
+ Introduce get_reply and get_sw_if_index.
+ Rename variables holding get_*() value,
  + e.g. get_stats() value is stored to variable named "stats".
  + Rename "item" of subsequent loop to hint the type instead.
  + Rename "details" function argument to "verbose".
+ Process reply details in place, instead of building new list.
  - Except hybrid blocks which can return both list or single item.
  - Except human readable text building blocks.
+ Rename most similar names to sw_if_index.
  - Except "vpp_sw_index" and some function names.
+ Use single run_cli_cmd from PapiExecutor.
+ Do not chain methods over multiple lines.
  + Small space gain is not worth readability loss.
+ Include minor code and docstrings improvement.
+ Add some TODOs.

Change-Id: Ib2110a3d2101a74d5837baab3a58dc46aafc6ce3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Avoid ci-management archiving files twice

https://gerrit.fd.io/r/20119
has changed the way archival works,
everything should now go to logs.fd.io
(instead of appearing on run page in jenkins.fd.io).

The glob pattern for archiving is quite eager,
doing recursive search. That is good, as it can find
also misplaced useful outputs.
But it also means our usage of copy_archives function
creates two copies of archived directories,
usually archives/ and archives/archive/.

This change simply removes copy_archives,
relying on the new recursive search.

A solution with changing ARCHIVE_DIR and moving if needed
would be better, but looking at amout of jobs
and various func bootstraps, it is not worth the effort.

Change-Id: Iad2bc09455944307e59eecafa64d1db6dc8befe8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

VPPD: Merge IPv4/IPv6

- Preparation for coverage.sh

Change-Id: Id299df9cd57ee69116686c8bc85eaba1cc353122
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add per arch mrr daily test for denverton platform

Change-Id: Ica7d6bf0dbdfde3de70eabd131c79cadd8af3a16
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

CSIT-1477: add 1n_tx2 VPP Device

- add 1n_tx2 testbed
- update VF reservation to meet 1n_tx2 testbed needs
- update ansible with 1n_tx2

Change-Id: Ia075a913d4859f537fd0e6bff731ea88aff01dd9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

FIX: Various naming convention typos

Change-Id: Ib55d9f3993cb63d3130a6bd338d612bde0235d5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Aligning FUNC/PERF keywords - Data driven

Change-Id: I233c8908c724556db09c60de6efa9237068fb4c3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Fix few pylint violations

+ Stop attempting to check test/ as module inits are not there.

Change-Id: Ia4e498061be3e3118b07e98c9c2f761f2454653e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Tolerate failures when setting MTU

Because some NICs are known to not allow jumbo frames.

Change-Id: I45fe636e3a880c6640922468c170f50e85dd2ba2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: use correct slicing of classify mask/match string

Change-Id: I11cc8ddc6925b44a596aa03d71318efd76232d6d
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Bash functions style cleanup

+ Update rst documentation for bash style
 + Command substitution:
  + Clarify when to use backticks.
  + Recommend avoiding nested command substitution.
  + Do not recommend putting command substitution results into quotes.
 + Function definition content:
  + Move "set -exuo pipefail" after comment only blocks.
  + Other set flags allowed for functions with good reasons.
+ Apply the new recommendations.
 - Blank lines unified in code but no written recommendation in rst.
+ Add missing references to functions called, variables read or set.
 + Add TODOs to where lists would be long.
+ Minor improvements to function descriptions.
+ Make "if" expressions more python-like.
+ Add missing "|| die" (or "|| true") where spotted.
+ Downgrade DEFAULT_NIC to a local variable.
+ Add TODO to list reasons for blacklisted tags.

Change-Id: I05dce030a8c2cb1b3a242d8b977e8fe150d8ee20
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Modify kernel VM download to custom build

Instead of downloading linux-image-kvm, build custom initrd from
currently used kernel on perf sut or vpp device host.

Change-Id: I836f9c5264695c44566b7d52f3ec03e26a474524
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>

Add scale ipsec tunnel tests 20K

Change-Id: Ib52e1735b6b82ea9fea44c06c379f117068e94c1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1539 Aligning FUNC/PERF keywords - Phase III

Change-Id: Ibd3e99390bf004173d3d126946b95ffe9ba8f196
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 16.04:
   19.08-rc0~603-g69a85b5~b7459

 - use new vpp ref build - ubuntu 18.04:
   19.08-rc0~603-g69a85b505

 - use new vpp ref build - centos7:
   19.08-rc0~603_g69a85b5~b7350

Change-Id: I753e3ddd3a5e3f02ecdf11a600ea1b43e9e86d9c
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Next IETF draft version for PLRsearch

+ Finished the rewrite left in progress last time.
+ Described current logic (load selection) changed since last time.
+ Fixed fitting function formulas, normalization was wrong.
+ Other minor improvements.

Change-Id: I3d762db98b6f8789207bc58db1f171faa6e753bd
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Update of draft-vpolak-mkonstan-bmwg-mlrsearch-01->02.

Change-Id: Iba2d5369298f8615aacb1ff0f73b4832d359b433
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Update draft-mkonstan-nf-service-density-00->01

Change-Id: Ic63aa09bfff98d358b770e378c5571f1114839b8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Remove import of removed qemu.robot

The library got removed in https://gerrit.fd.io/r/20219
but the tests are passing in spite of import error.

Change-Id: Ide1b896415bbd84d5980d9308272ce57318173bf
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: VXLAN scale tests

Change-Id: I9287d5ed6d7876b98add3fb3d523e9764094843b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

FIX: ip scale needs sw_if_index in VAT command

Change-Id: Icb3e22a84af10b98edf83084991b8f2607c95798
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Remove redundant VIRL test

Change-Id: I368f4e07d578802973a1c5f6b15e170038d63238
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Remove pkt_trace as global variable

- Use explicit parameters

Change-Id: I21cbc8cf13ec5e455b20c685c4427a53a655f71f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add Additional Setup action for scapy

Change-Id: I82f70d7c80b921da03553f6c1351a9a2f786ff0e
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update draft-vpolak-bmwg-plrsearch-01->02

Change-Id: Ida23a50c9148570a6510f93a2bb731ea8b0b2b94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Bump stable VPP version to get VPP-1716 fix

Change-Id: I1438fd56f0271dc78967389df452d31b2c8da32d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: use len parameter name in prefix structure in ip_route_add_del

 + new vpp stabel build with fixed ipv6 address incrementation

Change-Id: Id3f4104a48e45b6fd70ccbd47ad9e3c6925220fd
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Fix typos in IPsec suites

Change-Id: I566e5e9ded9efb7b8d391fd77c567047f8a017ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Replace license checker with global notices

Caring about per-file notices is too distracting.

Change-Id: I3f07a9fd1d3a4350135dd3d14f4944647af39a0b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix missing separator issue of crypto ipsec test suites

Change-Id: Iaec8b496cfd40e9a24c2226c1f7c6f7dde6a3d82
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

FIX: re-introduce VAT for IP scale tests

Change-Id: I864118ee67628ea81f2f89dab5890df8fe15c4bc
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Add packet trace to teardown of all vpp-device func tests

Change-Id: I26ad1f9a481d3d7ecdb0ad4e85d521756302e09b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Fix missing pipe in ip6 suite

Change-Id: I905e6e744519bcdd07360376f9552c5cf895c976
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add copyright checker to tox

+ Only looks at files edited since HEAD~.
+ Only checks files of whitelisted extensions.
+ Distinguishes missing and outdated copyrights.
+ Any line with "Copyright" substring can work.
+ Many copyright lines are tolerated, if at least one has correct year.
+ Voting.

Change-Id: I2cda0459cb191eeec7aada69c508973568039d87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

PAPI-to-VAT: MACSwap

- not used, not needed, deleted

Change-Id: I9b4c78b7ba3fbac3805d06a65f2799ed212770b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Classify

Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: IPFIX and SPAN

Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Trace

Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: Remove unused VAT files.

Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: IPUtil after vpp api changes

 + do not log all ip_route_add_del api calls to PAPI history
   in case of scale tests

 + fix for SRv6 proxy tests

 + support of more complex structures in api calls/replies
   in PapiExecutor

 + update of vpp stable build to version 19.08-rc0~487-gb98dbb1

Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Introduce EXPECTED_FAILING

Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add support for more complex structures in PAPI calls/replies

Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Align suite/test teardown/setup

+ Phase II - aligning FUNC/PERF setup.
  + 2n/3n compatibility of suite setup.
  + Same structure of testcase for DEV/PERF.
  + DEVICE tests are now running VPP startup config in same
    way as PERF.
  + DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
  compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
  setup phase.

Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Store "tag" and "url" in files in reservation dir

String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.

+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.

Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Allow 9000b tests for AVF

See https://gerrit.fd.io/r/20148

Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Align suite/test teardown/setup

+ Phase I - aligning FUNC/PERF

Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: IPsec TNL test should load plugins

Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff
Signed-off-by: Peter Mikus <pmikus@cisco.com>

SetupFramework: log thread error to console

Because logger.error from a non-main thread is lost.

+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
  + Accept also commands of OptionString type.
  + Introduce a limited form of raise_from for exception chaining.
  + Add include_reason argument to exec_cmd_no_error.

Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

perf ipsec: test renaming

Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh

Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

Add continue/fail option for enable traces

Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Trending: Reduce the number of input files

Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VPPCounters

Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: NATUtil

Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1459: Migrate IP libraries from VAT to PAPI

Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>

VAT-to-PAPI: VPPUtils

Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add 2-node and 3-node denverton to specifications

Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

Add scale ipsec tunnel tests

- 5K
- 10K

Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add denverton servers to ansible lf_inventory hosts

Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>

Fix exit from reservation loop

Break from the while loop is on both success and no testbeds.

Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Continue reservation when cleanup fails

+ Only on not-failed-yet testbeds.
+ If any, else give up.

Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~446-g3860a77~b7297

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~446-g3860a77e9

- use new vpp ref build - centos7:
  19.08-rc0~446_g3860a77~b7181

Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25
Signed-off-by: Jan Gelety <jgelety@cisco.com>

PAPI: Reduce the amount of logged information

Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add more tests to daily jobs

+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.

New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223

Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report 1904: Configure rls 1904.25

Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: IPsec TNL mode func

Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Add hsw drivers to topology and check against AVF

Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add comments for some tag exclusions

Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: IPsec TNL mode

Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: IPsec INT mode

Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7
Signed-off-by: Peter Mikus <pmikus@cisco.com>

PAPI: Fix PyLint errors

Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: IPsec Functional teardown

Change-Id: If63d6815b4e0e9ed426e3bae8008635d9690c4a6
Signed-off-by: Peter Mikus <pmikus@cisco.com>

virl: re-distribute test suites to virl simulations

Change-Id: I7758d888f1a5edc42cba3c6131b8c882e709dc91
Signed-off-by: Jan Gelety <jgelety@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>

vpp_device: TAP

Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>

vpp_device: IPsec

- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)

Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Configure report 1904.24

Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Python3: TRex driver

Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c
Signed-off-by: Peter Mikus <pmikus@cisco.com>

FIX: Disable AVF on 3n-hsw

Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1521 Convert NestedVM testcase into KernelVM

Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Simplify mrr daily tag expression

The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.

New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126

More details included as diff files.

+ Less per-testbed exceptions.
- Single/double links tags still set at two places.

Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: OS detection

Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT changes to support new Centos 7 device testing container image.

CSIT-1505

Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.

Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos

Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>

Remove intrusive useless logging

Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Even more Crypto combinations

Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>

CSIT-1488: Add data to the Report 1904

Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: memif

Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fix Honeycomb failing tests

 - due to VAT to PAPI migration some tests
   need to be updated
 - fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
   Vhost, Vxlan, Vxlan-gpe

Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>

VAT-to-PAPI: ContainerUtils

Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

VAT-to-PAPI: VhostUser

Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>