csit.git
4 years agoFix missing pipe in ip6 suite 02/20402/2
Vratko Polak [Fri, 28 Jun 2019 16:21:08 +0000 (18:21 +0200)]
Fix missing pipe in ip6 suite

Change-Id: I905e6e744519bcdd07360376f9552c5cf895c976
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAdd copyright checker to tox 18/20318/3
Vratko Polak [Tue, 25 Jun 2019 10:46:12 +0000 (12:46 +0200)]
Add copyright checker to tox

+ Only looks at files edited since HEAD~.
+ Only checks files of whitelisted extensions.
+ Distinguishes missing and outdated copyrights.
+ Any line with "Copyright" substring can work.
+ Many copyright lines are tolerated, if at least one has correct year.
+ Voting.

Change-Id: I2cda0459cb191eeec7aada69c508973568039d87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoPAPI-to-VAT: MACSwap 97/20397/1
Tibor Frank [Fri, 28 Jun 2019 07:20:56 +0000 (09:20 +0200)]
PAPI-to-VAT: MACSwap

- not used, not needed, deleted

Change-Id: I9b4c78b7ba3fbac3805d06a65f2799ed212770b3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: Classify 24/20124/75
Tibor Frank [Fri, 14 Jun 2019 07:26:38 +0000 (09:26 +0200)]
VAT-to-PAPI: Classify

Change-Id: Ic06a0a65429680e6ecdc3f5288d091c2c2630921
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: IPFIX and SPAN 55/20355/4
Tibor Frank [Wed, 26 Jun 2019 10:56:04 +0000 (12:56 +0200)]
VAT-to-PAPI: IPFIX and SPAN

Change-Id: I34bdc17d6350e5a441dabd9154620627780f4c12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: Trace 57/20357/3
Tibor Frank [Wed, 26 Jun 2019 11:30:18 +0000 (13:30 +0200)]
VAT-to-PAPI: Trace

Change-Id: Id0b6943eec7e8a15cb2db5c89f93a38f21d686c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: Remove unused VAT files. 56/20356/2
Tibor Frank [Wed, 26 Jun 2019 11:05:18 +0000 (13:05 +0200)]
VAT-to-PAPI: Remove unused VAT files.

Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: IPUtil after vpp api changes 78/20278/27
Jan Gelety [Thu, 20 Jun 2019 17:49:35 +0000 (19:49 +0200)]
FIX: IPUtil after vpp api changes

 + do not log all ip_route_add_del api calls to PAPI history
   in case of scale tests

 + fix for SRv6 proxy tests

 + support of more complex structures in api calls/replies
   in PapiExecutor

 + update of vpp stable build to version 19.08-rc0~487-gb98dbb1

Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoIntroduce EXPECTED_FAILING 44/20344/1
Peter Mikus [Wed, 26 Jun 2019 05:40:21 +0000 (05:40 +0000)]
Introduce EXPECTED_FAILING

Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd support for more complex structures in PAPI calls/replies 27/20327/1
Jan Gelety [Sun, 16 Jun 2019 05:01:52 +0000 (07:01 +0200)]
Add support for more complex structures in PAPI calls/replies

Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoAlign suite/test teardown/setup 80/20280/30
Peter Mikus [Fri, 21 Jun 2019 12:15:56 +0000 (12:15 +0000)]
Align suite/test teardown/setup

+ Phase II - aligning FUNC/PERF setup.
  + 2n/3n compatibility of suite setup.
  + Same structure of testcase for DEV/PERF.
  + DEVICE tests are now running VPP startup config in same
    way as PERF.
  + DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
  compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
  setup phase.

Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoStore "tag" and "url" in files in reservation dir 09/20209/14
Vratko Polak [Mon, 24 Jun 2019 15:53:55 +0000 (17:53 +0200)]
Store "tag" and "url" in files in reservation dir

String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.

+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.

Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAllow 9000b tests for AVF 59/20259/2
Vratko Polak [Fri, 21 Jun 2019 16:26:26 +0000 (18:26 +0200)]
Allow 9000b tests for AVF

See https://gerrit.fd.io/r/20148

Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAlign suite/test teardown/setup 19/20219/22
Peter Mikus [Tue, 18 Jun 2019 20:31:48 +0000 (20:31 +0000)]
Align suite/test teardown/setup

+ Phase I - aligning FUNC/PERF

Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: IPsec TNL test should load plugins 79/20279/1
Peter Mikus [Fri, 21 Jun 2019 12:07:03 +0000 (12:07 +0000)]
FIX: IPsec TNL test should load plugins

Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoSetupFramework: log thread error to console 75/19875/30
Vratko Polak [Thu, 13 Jun 2019 14:58:30 +0000 (16:58 +0200)]
SetupFramework: log thread error to console

Because logger.error from a non-main thread is lost.

+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
  + Accept also commands of OptionString type.
  + Introduce a limited form of raise_from for exception chaining.
  + Add include_reason argument to exec_cmd_no_error.

Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoperf ipsec: test renaming 61/20261/1
Maciek Konstantynowicz [Thu, 20 Jun 2019 12:39:09 +0000 (13:39 +0100)]
perf ipsec: test renaming

Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
4 years agoAdd 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh 27/20227/3
Yulong Pei [Wed, 19 Jun 2019 14:47:46 +0000 (22:47 +0800)]
Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh

Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoAdd continue/fail option for enable traces 33/20233/3
Tibor Frank [Wed, 19 Jun 2019 12:14:10 +0000 (14:14 +0200)]
Add continue/fail option for enable traces

Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoTrending: Reduce the number of input files 38/20238/1
Tibor Frank [Wed, 19 Jun 2019 14:31:43 +0000 (16:31 +0200)]
Trending: Reduce the number of input files

Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: VPPCounters 24/19924/41
Tibor Frank [Mon, 3 Jun 2019 10:55:55 +0000 (12:55 +0200)]
VAT-to-PAPI: VPPCounters

Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: NATUtil 73/20073/22
Tibor Frank [Tue, 11 Jun 2019 12:38:06 +0000 (14:38 +0200)]
VAT-to-PAPI: NATUtil

Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1459: Migrate IP libraries from VAT to PAPI 13/19913/28
Jan Gelety [Thu, 30 May 2019 14:13:25 +0000 (16:13 +0200)]
CSIT-1459: Migrate IP libraries from VAT to PAPI

Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoVAT-to-PAPI: VPPUtils 57/20057/12
Tibor Frank [Mon, 10 Jun 2019 10:49:51 +0000 (12:49 +0200)]
VAT-to-PAPI: VPPUtils

Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd 2-node and 3-node denverton to specifications 03/20203/2
Yulong Pei [Tue, 18 Jun 2019 10:18:10 +0000 (18:18 +0800)]
Add 2-node and 3-node denverton to specifications

Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoAdd scale ipsec tunnel tests 24/20024/12
Peter Mikus [Fri, 7 Jun 2019 09:45:41 +0000 (09:45 +0000)]
Add scale ipsec tunnel tests

- 5K
- 10K

Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd denverton servers to ansible lf_inventory hosts 21/20221/1
Yulong Pei [Wed, 19 Jun 2019 09:30:59 +0000 (17:30 +0800)]
Add denverton servers to ansible lf_inventory hosts

Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
4 years agoFix exit from reservation loop 12/20212/1
Vratko Polak [Tue, 18 Jun 2019 13:04:07 +0000 (15:04 +0200)]
Fix exit from reservation loop

Break from the while loop is on both success and no testbeds.

Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoContinue reservation when cleanup fails 37/18637/8
Vratko Polak [Tue, 18 Jun 2019 12:17:07 +0000 (14:17 +0200)]
Continue reservation when cleanup fails

+ Only on not-failed-yet testbeds.
+ If any, else give up.

Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 05/20205/2
Jan Gelety [Fri, 14 Jun 2019 04:51:59 +0000 (06:51 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~446-g3860a77~b7297

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~446-g3860a77e9

- use new vpp ref build - centos7:
  19.08-rc0~446_g3860a77~b7181

Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoPAPI: Reduce the amount of logged information 51/20051/7
Tibor Frank [Mon, 10 Jun 2019 08:40:12 +0000 (10:40 +0200)]
PAPI: Reduce the amount of logged information

Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd more tests to daily jobs 13/20113/5
Vratko Polak [Thu, 13 Jun 2019 12:29:14 +0000 (14:29 +0200)]
Add more tests to daily jobs

+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.

New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223

Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 65/20165/1
Tibor Frank [Mon, 17 Jun 2019 07:42:43 +0000 (09:42 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport 1904: Configure rls 1904.25 63/20163/1
Tibor Frank [Mon, 17 Jun 2019 07:37:30 +0000 (09:37 +0200)]
Report 1904: Configure rls 1904.25

Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: IPsec TNL mode func 51/20151/3
Peter Mikus [Fri, 14 Jun 2019 20:36:41 +0000 (20:36 +0000)]
FIX: IPsec TNL mode func

Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoAdd hsw drivers to topology and check against AVF 18/20118/4
Vratko Polak [Fri, 14 Jun 2019 08:30:40 +0000 (10:30 +0200)]
Add hsw drivers to topology and check against AVF

Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoAdd comments for some tag exclusions 68/20068/6
Vratko Polak [Wed, 12 Jun 2019 10:28:45 +0000 (12:28 +0200)]
Add comments for some tag exclusions

Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoFIX: IPsec TNL mode 44/20144/4
Peter Mikus [Fri, 14 Jun 2019 15:41:42 +0000 (15:41 +0000)]
FIX: IPsec TNL mode

Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: IPsec INT mode 40/20140/2
Peter Mikus [Fri, 14 Jun 2019 15:00:17 +0000 (15:00 +0000)]
FIX: IPsec INT mode

Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPAPI: Fix PyLint errors 23/20123/2
Tibor Frank [Fri, 14 Jun 2019 06:31:18 +0000 (08:31 +0200)]
PAPI: Fix PyLint errors

Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: IPsec Functional teardown 21/20121/1
Peter Mikus [Fri, 14 Jun 2019 06:04:44 +0000 (06:04 +0000)]
FIX: IPsec Functional teardown

Change-Id: If63d6815b4e0e9ed426e3bae8008635d9690c4a6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agovirl: re-distribute test suites to virl simulations 85/20085/1
Jan Gelety [Tue, 4 Jun 2019 00:56:14 +0000 (02:56 +0200)]
virl: re-distribute test suites to virl simulations

Change-Id: I7758d888f1a5edc42cba3c6131b8c882e709dc91
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 80/20080/1
Tibor Frank [Wed, 12 Jun 2019 06:05:23 +0000 (08:05 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agovpp_device: TAP 46/20046/8
Peter Mikus [Sun, 9 Jun 2019 06:44:04 +0000 (06:44 +0000)]
vpp_device: TAP

Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agovpp_device: IPsec 30/20030/7
Peter Mikus [Fri, 7 Jun 2019 13:44:52 +0000 (13:44 +0000)]
vpp_device: IPsec

- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)

Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 55/20055/1
Tibor Frank [Mon, 10 Jun 2019 10:14:46 +0000 (12:14 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure report 1904.24 53/20053/1
Tibor Frank [Mon, 10 Jun 2019 10:08:21 +0000 (12:08 +0200)]
Report: Configure report 1904.24

Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoPython3: TRex driver 01/20001/3
Peter Mikus [Thu, 6 Jun 2019 12:19:59 +0000 (12:19 +0000)]
Python3: TRex driver

Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoFIX: Disable AVF on 3n-hsw 44/20044/2
Peter Mikus [Sun, 9 Jun 2019 05:59:57 +0000 (05:59 +0000)]
FIX: Disable AVF on 3n-hsw

Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1521 Convert NestedVM testcase into KernelVM 00/20000/7
Peter Mikus [Thu, 6 Jun 2019 12:16:12 +0000 (12:16 +0000)]
CSIT-1521 Convert NestedVM testcase into KernelVM

Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoSimplify mrr daily tag expression 83/19983/10
Vratko Polak [Thu, 6 Jun 2019 10:33:20 +0000 (12:33 +0200)]
Simplify mrr daily tag expression

The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.

New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126

More details included as diff files.

+ Less per-testbed exceptions.
- Single/double links tags still set at two places.

Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 70/19970/1
Tibor Frank [Wed, 5 Jun 2019 11:36:38 +0000 (13:36 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: OS detection 69/19969/3
Peter Mikus [Wed, 5 Jun 2019 08:59:37 +0000 (08:59 +0000)]
FIX: OS detection

Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT changes to support new Centos 7 device testing container image. 97/19697/7
Thomas F Herbert [Sat, 18 May 2019 19:12:52 +0000 (15:12 -0400)]
CSIT changes to support new Centos 7 device testing container image.

CSIT-1505

Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.

Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos

Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
4 years agoRemove intrusive useless logging 65/19965/1
Peter Mikus [Wed, 5 Jun 2019 06:52:37 +0000 (06:52 +0000)]
Remove intrusive useless logging

Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoEven more Crypto combinations 25/19825/14
Peter Mikus [Fri, 24 May 2019 18:16:41 +0000 (18:16 +0000)]
Even more Crypto combinations

Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 52/19952/1
Tibor Frank [Tue, 4 Jun 2019 13:22:17 +0000 (15:22 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: memif 39/19639/22
Tibor Frank [Thu, 16 May 2019 11:47:50 +0000 (13:47 +0200)]
VAT-to-PAPI: memif

Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agofix Honeycomb failing tests 36/19936/4
Michal Cmarada [Tue, 4 Jun 2019 09:53:38 +0000 (11:53 +0200)]
fix Honeycomb failing tests

 - due to VAT to PAPI migration some tests
   need to be updated
 - fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
   Vhost, Vxlan, Vxlan-gpe

Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
4 years agoVAT-to-PAPI: ContainerUtils 18/19918/7
Tibor Frank [Mon, 3 Jun 2019 07:23:15 +0000 (09:23 +0200)]
VAT-to-PAPI: ContainerUtils

Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoVAT-to-PAPI: VhostUser 99/19899/6
Tibor Frank [Thu, 30 May 2019 13:18:31 +0000 (15:18 +0200)]
VAT-to-PAPI: VhostUser

Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd possibility to use other then default NIC per VPP patch 00/19900/2
Jan Gelety [Thu, 30 May 2019 13:02:09 +0000 (15:02 +0200)]
Add possibility to use other then default NIC per VPP patch

Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoUpdate of VPP_STABLE_VER files 19/19919/2
Jan Gelety [Sat, 1 Jun 2019 12:21:27 +0000 (14:21 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~341-gb19bf8d~b7191

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~341-gb19bf8de1

- use new vpp ref build - centos7:
  19.08-rc0~341_gb19bf8d~b7065

Change-Id: I62b61b8d91dce90dfd241d8325b0049c1c02b6a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 22/19922/1
Tibor Frank [Mon, 3 Jun 2019 10:25:20 +0000 (12:25 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I514dbd61dc22736fb3925d6d3cec767d0f4f84a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Configure Report 1904.23 20/19920/2
Tibor Frank [Mon, 3 Jun 2019 10:16:35 +0000 (12:16 +0200)]
Report: Configure Report 1904.23

Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAdd meltdown spectre to calibration set 09/19909/3
Peter Mikus [Fri, 31 May 2019 09:25:50 +0000 (09:25 +0000)]
Add meltdown spectre to calibration set

+ Fix the version of MMD tool to always latest

Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1468: InterfaceUtil migration from VAT to PAPI 60/18360/67
Jan Gelety [Mon, 18 Mar 2019 12:30:11 +0000 (13:30 +0100)]
CSIT-1468: InterfaceUtil migration from VAT to PAPI

Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoFix args order in setup_node call 68/19868/1
juraj.linkes [Wed, 29 May 2019 09:02:42 +0000 (11:02 +0200)]
Fix args order in setup_node call

Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoUse threads for fw setup and cleanup 10/19810/6
juraj.linkes [Fri, 24 May 2019 08:58:52 +0000 (10:58 +0200)]
Use threads for fw setup and cleanup

Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.

Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
4 years agoFIX: Trex 2.54 resolve issue. 50/19850/2
Peter Mikus [Tue, 28 May 2019 06:51:12 +0000 (06:51 +0000)]
FIX: Trex 2.54 resolve issue.

Change-Id: I8ffb360411fe5a0304ba7568828588dc7cfad267
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 52/19852/1
Tibor Frank [Tue, 28 May 2019 07:15:34 +0000 (09:15 +0200)]
CSIT-1488: Add data to the Report 1904

- remove 'NIC_Cisco-VIC-1385' and '9000B' from vpp perf full

Change-Id: Ic3d6a035945eddf6a5f5c73a62ca872a59c18b46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoHC2VPP-411: migrate interfaces-state to interfaces 38/19838/4
Michal Cmarada [Mon, 27 May 2019 11:58:23 +0000 (13:58 +0200)]
HC2VPP-411: migrate interfaces-state to interfaces

 - new ietf-interfaces makes interfaces-state obsolete
 - updates honeycomb tests to latest ietf-interfaces model

Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
4 years agoFIX: do not generate 9000B perf test in case of vic1385 nic 34/19834/2
Jan Gelety [Thu, 23 May 2019 07:45:01 +0000 (09:45 +0200)]
FIX: do not generate 9000B perf test in case of vic1385 nic

Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 36/19836/1
Tibor Frank [Mon, 27 May 2019 08:56:53 +0000 (10:56 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: If23ed1d2a8b716a2c145a8b13ebc91c9925284d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1425 Upgrade TRex to v2.54 18/17418/21
Tibor Frank [Tue, 5 Feb 2019 09:20:41 +0000 (10:20 +0100)]
CSIT-1425 Upgrade TRex to v2.54

Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Configure Report 1904.22 06/19806/1
Tibor Frank [Fri, 24 May 2019 07:33:58 +0000 (09:33 +0200)]
Report: Configure Report 1904.22

Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 04/19804/1
Tibor Frank [Fri, 24 May 2019 07:29:59 +0000 (09:29 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I23224cba405ad905b65799682f59de126d88bc2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: IPsec typo 71/19771/1
Peter Mikus [Thu, 23 May 2019 07:23:22 +0000 (07:23 +0000)]
FIX: IPsec typo

Change-Id: Ic565a5caea57b05e6905698f68fcf2146ae14d72
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoPAL: Add IPSEC to mapping table 83/19683/4
Tibor Frank [Fri, 17 May 2019 13:08:13 +0000 (15:08 +0200)]
PAL: Add IPSEC to mapping table

- waiting for https://gerrit.fd.io/r/19677
- waiting for https://gerrit.fd.io/r/19710

Change-Id: I1c4a09ded8402d9ce60e021414ce7f46781526b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1507: Rework IPsec base testcases 10/19710/2
Peter Mikus [Mon, 20 May 2019 09:56:19 +0000 (09:56 +0000)]
CSIT-1507: Rework IPsec base testcases

Change-Id: Ifb65ad8da9c5b1ef10a65a5174b698f86d2dc9d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1506: Rework IPsec base testcases 77/19677/7
Peter Mikus [Fri, 17 May 2019 12:17:06 +0000 (12:17 +0000)]
CSIT-1506: Rework IPsec base testcases

- Add:
    aes-128-gcm        aes-128-gcm
    aes-256-gcm        aes-256-gcm
    aes-128-cbc        hmac-sha-256
    aes-256-cbc        hmac-sha-512

- Remove:
    hmac-sha1

- Scale will follow in next patch

Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoRe-enable T22 into pool 51/19751/2
Peter Mikus [Wed, 22 May 2019 09:35:56 +0000 (09:35 +0000)]
Re-enable T22 into pool

- Server reinstalled via cobbler

Change-Id: Ic0d45f0b874059af2568d6483517107924a7c66a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoReport: Update report history 55/19755/1
Tibor Frank [Wed, 22 May 2019 10:41:05 +0000 (12:41 +0200)]
Report: Update report history

Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix missing func and vpp_device data 53/19753/1
Tibor Frank [Wed, 22 May 2019 10:35:42 +0000 (12:35 +0200)]
Report: Fix missing func and vpp_device data

Change-Id: Id21e52262904baa9a940e5680a413a1f5ae06b8b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoAnsible: Add CIMC/IPMI/COBBLER 01/17801/19
Peter Mikus [Sat, 23 Feb 2019 16:27:07 +0000 (16:27 +0000)]
Ansible: Add CIMC/IPMI/COBBLER

- added tasks and handlers for CIMC, IPMI, COBBLER
- allows provisioning of servers via COBBLER

Change-Id: I64080069260dabb8a6e3b648aeff12f109d3f7c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 48/19748/2
Tibor Frank [Wed, 22 May 2019 07:59:18 +0000 (09:59 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I3af37de91450a4ac11eb6e6e8cd271de41e985bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoExclude IPSECHW tests on NICs other than xl710 32/19732/2
Vratko Polak [Tue, 21 May 2019 08:34:30 +0000 (10:34 +0200)]
Exclude IPSECHW tests on NICs other than xl710

The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.

Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoUpdate Centos VIRL image to version 2.5 42/19742/1
Thomas F Herbert [Sun, 19 May 2019 21:17:51 +0000 (17:17 -0400)]
Update Centos VIRL image to version 2.5

Update CentOS release.
Add python34.

Change-Id: Ie0a11810c5b120cfd170dc4eaf3e72bbd3155d4a
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
4 years agoCSIT-1488: Add data to the Report 1904 38/19738/1
Tibor Frank [Tue, 21 May 2019 14:45:37 +0000 (16:45 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6c6f478a0dc54a10e4b7568dc86aa883e896e28a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX2: VTS cpu list 14/19714/2
Jan Gelety [Mon, 20 May 2019 12:04:16 +0000 (14:04 +0200)]
FIX2: VTS cpu list

Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoReport: Remove (IPSECHW and x520) tests from report 15/19715/2
Tibor Frank [Mon, 20 May 2019 12:20:42 +0000 (14:20 +0200)]
Report: Remove (IPSECHW and x520) tests from report

Change-Id: I1481cd889aab7cc1f8d6b7c3a3cd5e96e955bb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoFIX: VTS cpu list 11/19711/2
Jan Gelety [Mon, 20 May 2019 10:55:59 +0000 (12:55 +0200)]
FIX: VTS cpu list

Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 06/19706/1
Tibor Frank [Mon, 20 May 2019 08:31:19 +0000 (10:31 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I632ed9e00feb26b734f86bfe75dca9e14ac57f0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport: Fix internal links to PLRsearch methodology 80/19680/1
Vratko Polak [Fri, 17 May 2019 12:54:20 +0000 (14:54 +0200)]
Report: Fix internal links to PLRsearch methodology

Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoReport: table_soak_vs_ndr 74/19674/2
Tibor Frank [Fri, 17 May 2019 10:42:19 +0000 (12:42 +0200)]
Report: table_soak_vs_ndr

Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReduce the number of tests loops in virl timed jobs 71/19671/2
Jan Gelety [Thu, 16 May 2019 15:01:21 +0000 (17:01 +0200)]
Reduce the number of tests loops in virl timed jobs

- with current number of test loops jobs fail with timeout

Change-Id: Id08cd1a9221eda116e018a44bece68a494286169
Signed-off-by: Jan Gelety <jgelety@cisco.com>
4 years agoTrending: Reduce input data 66/19666/1
Tibor Frank [Fri, 17 May 2019 08:22:45 +0000 (10:22 +0200)]
Trending: Reduce input data

Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoCSIT-1488: Add data to the Report 1904 63/19663/3
Tibor Frank [Fri, 17 May 2019 07:28:20 +0000 (09:28 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ic693d6750007727b6e773e17f8f2fba2f96c2c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 years agoReport soak comparison: Add stdev for delta 19/19619/3
Vratko Polak [Wed, 15 May 2019 15:58:24 +0000 (17:58 +0200)]
Report soak comparison: Add stdev for delta

Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 years agoTests: Add IPSEC SW scale tests 31/19631/2
Tibor Frank [Thu, 16 May 2019 08:55:00 +0000 (10:55 +0200)]
Tests: Add IPSEC SW scale tests

Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>