csit.git
15 months agoIntroduce EXPECTED_FAILING 44/20344/1
Peter Mikus [Wed, 26 Jun 2019 05:40:21 +0000 (05:40 +0000)]
Introduce EXPECTED_FAILING

Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoAdd support for more complex structures in PAPI calls/replies 27/20327/1
Jan Gelety [Sun, 16 Jun 2019 05:01:52 +0000 (07:01 +0200)]
Add support for more complex structures in PAPI calls/replies

Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoAlign suite/test teardown/setup 80/20280/30
Peter Mikus [Fri, 21 Jun 2019 12:15:56 +0000 (12:15 +0000)]
Align suite/test teardown/setup

+ Phase II - aligning FUNC/PERF setup.
  + 2n/3n compatibility of suite setup.
  + Same structure of testcase for DEV/PERF.
  + DEVICE tests are now running VPP startup config in same
    way as PERF.
  + DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
  compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
  setup phase.

Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoStore "tag" and "url" in files in reservation dir 09/20209/14
Vratko Polak [Mon, 24 Jun 2019 15:53:55 +0000 (17:53 +0200)]
Store "tag" and "url" in files in reservation dir

String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.

+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.

Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoAllow 9000b tests for AVF 59/20259/2
Vratko Polak [Fri, 21 Jun 2019 16:26:26 +0000 (18:26 +0200)]
Allow 9000b tests for AVF

See https://gerrit.fd.io/r/20148

Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoAlign suite/test teardown/setup 19/20219/22
Peter Mikus [Tue, 18 Jun 2019 20:31:48 +0000 (20:31 +0000)]
Align suite/test teardown/setup

+ Phase I - aligning FUNC/PERF

Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoFIX: IPsec TNL test should load plugins 79/20279/1
Peter Mikus [Fri, 21 Jun 2019 12:07:03 +0000 (12:07 +0000)]
FIX: IPsec TNL test should load plugins

Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoSetupFramework: log thread error to console 75/19875/30
Vratko Polak [Thu, 13 Jun 2019 14:58:30 +0000 (16:58 +0200)]
SetupFramework: log thread error to console

Because logger.error from a non-main thread is lost.

+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
  + Accept also commands of OptionString type.
  + Introduce a limited form of raise_from for exception chaining.
  + Add include_reason argument to exec_cmd_no_error.

Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoperf ipsec: test renaming 61/20261/1
Maciek Konstantynowicz [Thu, 20 Jun 2019 12:39:09 +0000 (13:39 +0100)]
perf ipsec: test renaming

Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
15 months agoAdd 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh 27/20227/3
Yulong Pei [Wed, 19 Jun 2019 14:47:46 +0000 (22:47 +0800)]
Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh

Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
15 months agoAdd continue/fail option for enable traces 33/20233/3
Tibor Frank [Wed, 19 Jun 2019 12:14:10 +0000 (14:14 +0200)]
Add continue/fail option for enable traces

Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoTrending: Reduce the number of input files 38/20238/1
Tibor Frank [Wed, 19 Jun 2019 14:31:43 +0000 (16:31 +0200)]
Trending: Reduce the number of input files

Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoVAT-to-PAPI: VPPCounters 24/19924/41
Tibor Frank [Mon, 3 Jun 2019 10:55:55 +0000 (12:55 +0200)]
VAT-to-PAPI: VPPCounters

Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoVAT-to-PAPI: NATUtil 73/20073/22
Tibor Frank [Tue, 11 Jun 2019 12:38:06 +0000 (14:38 +0200)]
VAT-to-PAPI: NATUtil

Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoCSIT-1459: Migrate IP libraries from VAT to PAPI 13/19913/28
Jan Gelety [Thu, 30 May 2019 14:13:25 +0000 (16:13 +0200)]
CSIT-1459: Migrate IP libraries from VAT to PAPI

Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoVAT-to-PAPI: VPPUtils 57/20057/12
Tibor Frank [Mon, 10 Jun 2019 10:49:51 +0000 (12:49 +0200)]
VAT-to-PAPI: VPPUtils

Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoAdd 2-node and 3-node denverton to specifications 03/20203/2
Yulong Pei [Tue, 18 Jun 2019 10:18:10 +0000 (18:18 +0800)]
Add 2-node and 3-node denverton to specifications

Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
15 months agoAdd scale ipsec tunnel tests 24/20024/12
Peter Mikus [Fri, 7 Jun 2019 09:45:41 +0000 (09:45 +0000)]
Add scale ipsec tunnel tests

- 5K
- 10K

Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoAdd denverton servers to ansible lf_inventory hosts 21/20221/1
Yulong Pei [Wed, 19 Jun 2019 09:30:59 +0000 (17:30 +0800)]
Add denverton servers to ansible lf_inventory hosts

Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
15 months agoFix exit from reservation loop 12/20212/1
Vratko Polak [Tue, 18 Jun 2019 13:04:07 +0000 (15:04 +0200)]
Fix exit from reservation loop

Break from the while loop is on both success and no testbeds.

Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoContinue reservation when cleanup fails 37/18637/8
Vratko Polak [Tue, 18 Jun 2019 12:17:07 +0000 (14:17 +0200)]
Continue reservation when cleanup fails

+ Only on not-failed-yet testbeds.
+ If any, else give up.

Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoUpdate of VPP_STABLE_VER files 05/20205/2
Jan Gelety [Fri, 14 Jun 2019 04:51:59 +0000 (06:51 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~446-g3860a77~b7297

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~446-g3860a77e9

- use new vpp ref build - centos7:
  19.08-rc0~446_g3860a77~b7181

Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoPAPI: Reduce the amount of logged information 51/20051/7
Tibor Frank [Mon, 10 Jun 2019 08:40:12 +0000 (10:40 +0200)]
PAPI: Reduce the amount of logged information

Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoAdd more tests to daily jobs 13/20113/5
Vratko Polak [Thu, 13 Jun 2019 12:29:14 +0000 (14:29 +0200)]
Add more tests to daily jobs

+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.

New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223

Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoCSIT-1488: Add data to the Report 1904 65/20165/1
Tibor Frank [Mon, 17 Jun 2019 07:42:43 +0000 (09:42 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoReport 1904: Configure rls 1904.25 63/20163/1
Tibor Frank [Mon, 17 Jun 2019 07:37:30 +0000 (09:37 +0200)]
Report 1904: Configure rls 1904.25

Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoFIX: IPsec TNL mode func 51/20151/3
Peter Mikus [Fri, 14 Jun 2019 20:36:41 +0000 (20:36 +0000)]
FIX: IPsec TNL mode func

Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoAdd hsw drivers to topology and check against AVF 18/20118/4
Vratko Polak [Fri, 14 Jun 2019 08:30:40 +0000 (10:30 +0200)]
Add hsw drivers to topology and check against AVF

Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoAdd comments for some tag exclusions 68/20068/6
Vratko Polak [Wed, 12 Jun 2019 10:28:45 +0000 (12:28 +0200)]
Add comments for some tag exclusions

Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoFIX: IPsec TNL mode 44/20144/4
Peter Mikus [Fri, 14 Jun 2019 15:41:42 +0000 (15:41 +0000)]
FIX: IPsec TNL mode

Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoFIX: IPsec INT mode 40/20140/2
Peter Mikus [Fri, 14 Jun 2019 15:00:17 +0000 (15:00 +0000)]
FIX: IPsec INT mode

Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoPAPI: Fix PyLint errors 23/20123/2
Tibor Frank [Fri, 14 Jun 2019 06:31:18 +0000 (08:31 +0200)]
PAPI: Fix PyLint errors

Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoFIX: IPsec Functional teardown 21/20121/1
Peter Mikus [Fri, 14 Jun 2019 06:04:44 +0000 (06:04 +0000)]
FIX: IPsec Functional teardown

Change-Id: If63d6815b4e0e9ed426e3bae8008635d9690c4a6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agovirl: re-distribute test suites to virl simulations 85/20085/1
Jan Gelety [Tue, 4 Jun 2019 00:56:14 +0000 (02:56 +0200)]
virl: re-distribute test suites to virl simulations

Change-Id: I7758d888f1a5edc42cba3c6131b8c882e709dc91
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoCSIT-1488: Add data to the Report 1904 80/20080/1
Tibor Frank [Wed, 12 Jun 2019 06:05:23 +0000 (08:05 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agovpp_device: TAP 46/20046/8
Peter Mikus [Sun, 9 Jun 2019 06:44:04 +0000 (06:44 +0000)]
vpp_device: TAP

Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agovpp_device: IPsec 30/20030/7
Peter Mikus [Fri, 7 Jun 2019 13:44:52 +0000 (13:44 +0000)]
vpp_device: IPsec

- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)

Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoCSIT-1488: Add data to the Report 1904 55/20055/1
Tibor Frank [Mon, 10 Jun 2019 10:14:46 +0000 (12:14 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoReport: Configure report 1904.24 53/20053/1
Tibor Frank [Mon, 10 Jun 2019 10:08:21 +0000 (12:08 +0200)]
Report: Configure report 1904.24

Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoPython3: TRex driver 01/20001/3
Peter Mikus [Thu, 6 Jun 2019 12:19:59 +0000 (12:19 +0000)]
Python3: TRex driver

Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoFIX: Disable AVF on 3n-hsw 44/20044/2
Peter Mikus [Sun, 9 Jun 2019 05:59:57 +0000 (05:59 +0000)]
FIX: Disable AVF on 3n-hsw

Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoCSIT-1521 Convert NestedVM testcase into KernelVM 00/20000/7
Peter Mikus [Thu, 6 Jun 2019 12:16:12 +0000 (12:16 +0000)]
CSIT-1521 Convert NestedVM testcase into KernelVM

Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoSimplify mrr daily tag expression 83/19983/10
Vratko Polak [Thu, 6 Jun 2019 10:33:20 +0000 (12:33 +0200)]
Simplify mrr daily tag expression

The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.

New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126

More details included as diff files.

+ Less per-testbed exceptions.
- Single/double links tags still set at two places.

Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
15 months agoCSIT-1488: Add data to the Report 1904 70/19970/1
Tibor Frank [Wed, 5 Jun 2019 11:36:38 +0000 (13:36 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoFIX: OS detection 69/19969/3
Peter Mikus [Wed, 5 Jun 2019 08:59:37 +0000 (08:59 +0000)]
FIX: OS detection

Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoCSIT changes to support new Centos 7 device testing container image. 97/19697/7
Thomas F Herbert [Sat, 18 May 2019 19:12:52 +0000 (15:12 -0400)]
CSIT changes to support new Centos 7 device testing container image.

CSIT-1505

Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.

Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos

Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
15 months agoRemove intrusive useless logging 65/19965/1
Peter Mikus [Wed, 5 Jun 2019 06:52:37 +0000 (06:52 +0000)]
Remove intrusive useless logging

Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoEven more Crypto combinations 25/19825/14
Peter Mikus [Fri, 24 May 2019 18:16:41 +0000 (18:16 +0000)]
Even more Crypto combinations

Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoCSIT-1488: Add data to the Report 1904 52/19952/1
Tibor Frank [Tue, 4 Jun 2019 13:22:17 +0000 (15:22 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoVAT-to-PAPI: memif 39/19639/22
Tibor Frank [Thu, 16 May 2019 11:47:50 +0000 (13:47 +0200)]
VAT-to-PAPI: memif

Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agofix Honeycomb failing tests 36/19936/4
Michal Cmarada [Tue, 4 Jun 2019 09:53:38 +0000 (11:53 +0200)]
fix Honeycomb failing tests

 - due to VAT to PAPI migration some tests
   need to be updated
 - fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
   Vhost, Vxlan, Vxlan-gpe

Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
15 months agoVAT-to-PAPI: ContainerUtils 18/19918/7
Tibor Frank [Mon, 3 Jun 2019 07:23:15 +0000 (09:23 +0200)]
VAT-to-PAPI: ContainerUtils

Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoVAT-to-PAPI: VhostUser 99/19899/6
Tibor Frank [Thu, 30 May 2019 13:18:31 +0000 (15:18 +0200)]
VAT-to-PAPI: VhostUser

Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoAdd possibility to use other then default NIC per VPP patch 00/19900/2
Jan Gelety [Thu, 30 May 2019 13:02:09 +0000 (15:02 +0200)]
Add possibility to use other then default NIC per VPP patch

Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoUpdate of VPP_STABLE_VER files 19/19919/2
Jan Gelety [Sat, 1 Jun 2019 12:21:27 +0000 (14:21 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~341-gb19bf8d~b7191

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~341-gb19bf8de1

- use new vpp ref build - centos7:
  19.08-rc0~341_gb19bf8d~b7065

Change-Id: I62b61b8d91dce90dfd241d8325b0049c1c02b6a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoCSIT-1488: Add data to the Report 1904 22/19922/1
Tibor Frank [Mon, 3 Jun 2019 10:25:20 +0000 (12:25 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I514dbd61dc22736fb3925d6d3cec767d0f4f84a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoReport: Configure Report 1904.23 20/19920/2
Tibor Frank [Mon, 3 Jun 2019 10:16:35 +0000 (12:16 +0200)]
Report: Configure Report 1904.23

Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
15 months agoAdd meltdown spectre to calibration set 09/19909/3
Peter Mikus [Fri, 31 May 2019 09:25:50 +0000 (09:25 +0000)]
Add meltdown spectre to calibration set

+ Fix the version of MMD tool to always latest

Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>
15 months agoCSIT-1468: InterfaceUtil migration from VAT to PAPI 60/18360/67
Jan Gelety [Mon, 18 Mar 2019 12:30:11 +0000 (13:30 +0100)]
CSIT-1468: InterfaceUtil migration from VAT to PAPI

Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>
15 months agoFix args order in setup_node call 68/19868/1
juraj.linkes [Wed, 29 May 2019 09:02:42 +0000 (11:02 +0200)]
Fix args order in setup_node call

Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
16 months agoUse threads for fw setup and cleanup 10/19810/6
juraj.linkes [Fri, 24 May 2019 08:58:52 +0000 (10:58 +0200)]
Use threads for fw setup and cleanup

Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.

Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
16 months agoFIX: Trex 2.54 resolve issue. 50/19850/2
Peter Mikus [Tue, 28 May 2019 06:51:12 +0000 (06:51 +0000)]
FIX: Trex 2.54 resolve issue.

Change-Id: I8ffb360411fe5a0304ba7568828588dc7cfad267
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 52/19852/1
Tibor Frank [Tue, 28 May 2019 07:15:34 +0000 (09:15 +0200)]
CSIT-1488: Add data to the Report 1904

- remove 'NIC_Cisco-VIC-1385' and '9000B' from vpp perf full

Change-Id: Ic3d6a035945eddf6a5f5c73a62ca872a59c18b46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoHC2VPP-411: migrate interfaces-state to interfaces 38/19838/4
Michal Cmarada [Mon, 27 May 2019 11:58:23 +0000 (13:58 +0200)]
HC2VPP-411: migrate interfaces-state to interfaces

 - new ietf-interfaces makes interfaces-state obsolete
 - updates honeycomb tests to latest ietf-interfaces model

Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
16 months agoFIX: do not generate 9000B perf test in case of vic1385 nic 34/19834/2
Jan Gelety [Thu, 23 May 2019 07:45:01 +0000 (09:45 +0200)]
FIX: do not generate 9000B perf test in case of vic1385 nic

Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 36/19836/1
Tibor Frank [Mon, 27 May 2019 08:56:53 +0000 (10:56 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: If23ed1d2a8b716a2c145a8b13ebc91c9925284d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoCSIT-1425 Upgrade TRex to v2.54 18/17418/21
Tibor Frank [Tue, 5 Feb 2019 09:20:41 +0000 (10:20 +0100)]
CSIT-1425 Upgrade TRex to v2.54

Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoReport: Configure Report 1904.22 06/19806/1
Tibor Frank [Fri, 24 May 2019 07:33:58 +0000 (09:33 +0200)]
Report: Configure Report 1904.22

Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 04/19804/1
Tibor Frank [Fri, 24 May 2019 07:29:59 +0000 (09:29 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I23224cba405ad905b65799682f59de126d88bc2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoFIX: IPsec typo 71/19771/1
Peter Mikus [Thu, 23 May 2019 07:23:22 +0000 (07:23 +0000)]
FIX: IPsec typo

Change-Id: Ic565a5caea57b05e6905698f68fcf2146ae14d72
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoPAL: Add IPSEC to mapping table 83/19683/4
Tibor Frank [Fri, 17 May 2019 13:08:13 +0000 (15:08 +0200)]
PAL: Add IPSEC to mapping table

- waiting for https://gerrit.fd.io/r/19677
- waiting for https://gerrit.fd.io/r/19710

Change-Id: I1c4a09ded8402d9ce60e021414ce7f46781526b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoCSIT-1507: Rework IPsec base testcases 10/19710/2
Peter Mikus [Mon, 20 May 2019 09:56:19 +0000 (09:56 +0000)]
CSIT-1507: Rework IPsec base testcases

Change-Id: Ifb65ad8da9c5b1ef10a65a5174b698f86d2dc9d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT-1506: Rework IPsec base testcases 77/19677/7
Peter Mikus [Fri, 17 May 2019 12:17:06 +0000 (12:17 +0000)]
CSIT-1506: Rework IPsec base testcases

- Add:
    aes-128-gcm        aes-128-gcm
    aes-256-gcm        aes-256-gcm
    aes-128-cbc        hmac-sha-256
    aes-256-cbc        hmac-sha-512

- Remove:
    hmac-sha1

- Scale will follow in next patch

Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoRe-enable T22 into pool 51/19751/2
Peter Mikus [Wed, 22 May 2019 09:35:56 +0000 (09:35 +0000)]
Re-enable T22 into pool

- Server reinstalled via cobbler

Change-Id: Ic0d45f0b874059af2568d6483517107924a7c66a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoReport: Update report history 55/19755/1
Tibor Frank [Wed, 22 May 2019 10:41:05 +0000 (12:41 +0200)]
Report: Update report history

Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReport: Fix missing func and vpp_device data 53/19753/1
Tibor Frank [Wed, 22 May 2019 10:35:42 +0000 (12:35 +0200)]
Report: Fix missing func and vpp_device data

Change-Id: Id21e52262904baa9a940e5680a413a1f5ae06b8b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoAnsible: Add CIMC/IPMI/COBBLER 01/17801/19
Peter Mikus [Sat, 23 Feb 2019 16:27:07 +0000 (16:27 +0000)]
Ansible: Add CIMC/IPMI/COBBLER

- added tasks and handlers for CIMC, IPMI, COBBLER
- allows provisioning of servers via COBBLER

Change-Id: I64080069260dabb8a6e3b648aeff12f109d3f7c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 48/19748/2
Tibor Frank [Wed, 22 May 2019 07:59:18 +0000 (09:59 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I3af37de91450a4ac11eb6e6e8cd271de41e985bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoExclude IPSECHW tests on NICs other than xl710 32/19732/2
Vratko Polak [Tue, 21 May 2019 08:34:30 +0000 (10:34 +0200)]
Exclude IPSECHW tests on NICs other than xl710

The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.

Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoUpdate Centos VIRL image to version 2.5 42/19742/1
Thomas F Herbert [Sun, 19 May 2019 21:17:51 +0000 (17:17 -0400)]
Update Centos VIRL image to version 2.5

Update CentOS release.
Add python34.

Change-Id: Ie0a11810c5b120cfd170dc4eaf3e72bbd3155d4a
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
16 months agoCSIT-1488: Add data to the Report 1904 38/19738/1
Tibor Frank [Tue, 21 May 2019 14:45:37 +0000 (16:45 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I6c6f478a0dc54a10e4b7568dc86aa883e896e28a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoFIX2: VTS cpu list 14/19714/2
Jan Gelety [Mon, 20 May 2019 12:04:16 +0000 (14:04 +0200)]
FIX2: VTS cpu list

Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
16 months agoReport: Remove (IPSECHW and x520) tests from report 15/19715/2
Tibor Frank [Mon, 20 May 2019 12:20:42 +0000 (14:20 +0200)]
Report: Remove (IPSECHW and x520) tests from report

Change-Id: I1481cd889aab7cc1f8d6b7c3a3cd5e96e955bb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoFIX: VTS cpu list 11/19711/2
Jan Gelety [Mon, 20 May 2019 10:55:59 +0000 (12:55 +0200)]
FIX: VTS cpu list

Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 06/19706/1
Tibor Frank [Mon, 20 May 2019 08:31:19 +0000 (10:31 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I632ed9e00feb26b734f86bfe75dca9e14ac57f0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReport: Fix internal links to PLRsearch methodology 80/19680/1
Vratko Polak [Fri, 17 May 2019 12:54:20 +0000 (14:54 +0200)]
Report: Fix internal links to PLRsearch methodology

Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoReport: table_soak_vs_ndr 74/19674/2
Tibor Frank [Fri, 17 May 2019 10:42:19 +0000 (12:42 +0200)]
Report: table_soak_vs_ndr

Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReduce the number of tests loops in virl timed jobs 71/19671/2
Jan Gelety [Thu, 16 May 2019 15:01:21 +0000 (17:01 +0200)]
Reduce the number of tests loops in virl timed jobs

- with current number of test loops jobs fail with timeout

Change-Id: Id08cd1a9221eda116e018a44bece68a494286169
Signed-off-by: Jan Gelety <jgelety@cisco.com>
16 months agoTrending: Reduce input data 66/19666/1
Tibor Frank [Fri, 17 May 2019 08:22:45 +0000 (10:22 +0200)]
Trending: Reduce input data

Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 63/19663/3
Tibor Frank [Fri, 17 May 2019 07:28:20 +0000 (09:28 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: Ic693d6750007727b6e773e17f8f2fba2f96c2c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReport soak comparison: Add stdev for delta 19/19619/3
Vratko Polak [Wed, 15 May 2019 15:58:24 +0000 (17:58 +0200)]
Report soak comparison: Add stdev for delta

Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoTests: Add IPSEC SW scale tests 31/19631/2
Tibor Frank [Thu, 16 May 2019 08:55:00 +0000 (10:55 +0200)]
Tests: Add IPSEC SW scale tests

Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoAvoid !r format appending u on unicode 58/19558/4
Vratko Polak [Tue, 14 May 2019 08:51:15 +0000 (10:51 +0200)]
Avoid !r format appending u on unicode

Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoFIX: IPsec selection backend. 37/19637/2
Peter Mikus [Thu, 16 May 2019 11:17:34 +0000 (11:17 +0000)]
FIX: IPsec selection backend.

Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoMake topology files read dynamically from directory 94/19594/6
Peter Mikus [Tue, 14 May 2019 14:39:56 +0000 (14:39 +0000)]
Make topology files read dynamically from directory

Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
16 months agoImprove soak graphs and content 29/19629/1
Vratko Polak [Thu, 16 May 2019 08:43:31 +0000 (10:43 +0200)]
Improve soak graphs and content

+ Fix duration, mention number of tests and runs.
- Hover information still feels wrong.
+ Mention "critical rate" instead of "throughput" where possible.
+ Mention lower bounds are displayed.
+ Rename "plrsearch_algorithm" label to "PLRsearch".
  + Because the previous link did not work. Due to underscore?
+ Rename "SOAK" to "soak" or "Soak" (except when it is a tag).

Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoCSIT-1488: Add data to the Report 1904 27/19627/1
Tibor Frank [Thu, 16 May 2019 08:27:03 +0000 (10:27 +0200)]
CSIT-1488: Add data to the Report 1904

Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoReport: Configure 1904.21 25/19625/1
Tibor Frank [Thu, 16 May 2019 06:42:59 +0000 (08:42 +0200)]
Report: Configure 1904.21

Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503
Signed-off-by: Tibor Frank <tifrank@cisco.com>
16 months agoAvoid double link tests for nic_intel-xxv710 17/19617/1
Vratko Polak [Wed, 15 May 2019 14:39:53 +0000 (16:39 +0200)]
Avoid double link tests for nic_intel-xxv710

Change-Id: Id9beeed270b91a35108adef594f50105198225d6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
16 months agoUpdate of VPP_STABLE_VER files + quick fix for gre create tunnel 64/19564/3
Jan Gelety [Sat, 11 May 2019 04:52:56 +0000 (06:52 +0200)]
Update of VPP_STABLE_VER files + quick fix for gre create tunnel

- use new vpp ref build - ubuntu 16.04:
  19.08-rc0~212-gf6c7aec~b7060

- use new vpp ref build - ubuntu 18.04:
  19.08-rc0~212-gf6c7aec95

- use new vpp ref build - centos7:
  19.08-rc0~212_gf6c7aec~b6916

Change-Id: Ifd042fae1a46b07a5f463309f2b9cceb8054412f
Signed-off-by: Jan Gelety <jgelety@cisco.com>

©2016 FD.io a Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation. Linux is a registered trademark of Linus Torvalds.
Please see our privacy policy and terms of use.