Tibor Frank [Wed, 26 Jun 2019 11:05:18 +0000 (13:05 +0200)]
VAT-to-PAPI: Remove unused VAT files.
Change-Id: I1563db488e9dd690aa7e732691e306a9e51ececa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 20 Jun 2019 17:49:35 +0000 (19:49 +0200)]
FIX: IPUtil after vpp api changes
+ do not log all ip_route_add_del api calls to PAPI history
in case of scale tests
+ fix for SRv6 proxy tests
+ support of more complex structures in api calls/replies
in PapiExecutor
+ update of vpp stable build to version 19.08-rc0~
487-gb98dbb1
Change-Id: I9972e126b68ce1cb57f781e3d90ea9b3914de69e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 26 Jun 2019 05:40:21 +0000 (05:40 +0000)]
Introduce EXPECTED_FAILING
Change-Id: I6c578e9126778c584ccb57a4a2c76d96dea8fb35
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Sun, 16 Jun 2019 05:01:52 +0000 (07:01 +0200)]
Add support for more complex structures in PAPI calls/replies
Change-Id: I3f83d1209a08dcf342cc2031191bb82cebc53e4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Fri, 21 Jun 2019 12:15:56 +0000 (12:15 +0000)]
Align suite/test teardown/setup
+ Phase II - aligning FUNC/PERF setup.
+ 2n/3n compatibility of suite setup.
+ Same structure of testcase for DEV/PERF.
+ DEVICE tests are now running VPP startup config in same
way as PERF.
+ DEVICE is using COREKEEPER!
- DEVICE tests are running topology compute twice for backward
compatibility. TODO to remove.
- Still phase III needed to align TAGS, LIBRARIES and remove OLD
setup phase.
Change-Id: Ib6e1b0ebf4abebf3cbe73b4fda5cac953c2a7270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Mon, 24 Jun 2019 15:53:55 +0000 (17:53 +0200)]
Store "tag" and "url" in files in reservation dir
String "Unknown" is used if test run tag or url is not supplied,
so this change should be backward compatible.
+ Used "runtag", as both "test" and "tag" start with taken "-t".
+ Fixed some pylint violations.
+ Docstring explaining the steps taken and reasoning behind two files.
+ Other minor improvements.
Change-Id: If704d02e51374087fe39ad0f69432477d1b310d3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 21 Jun 2019 16:26:26 +0000 (18:26 +0200)]
Allow 9000b tests for AVF
See https://gerrit.fd.io/r/20148
Change-Id: I22856b14e3608348f2ccecb1d99d87209db2d776
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 18 Jun 2019 20:31:48 +0000 (20:31 +0000)]
Align suite/test teardown/setup
+ Phase I - aligning FUNC/PERF
Change-Id: I46b1e43687ddb29f5ed3c6335fe1baf21ec02822
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 21 Jun 2019 12:07:03 +0000 (12:07 +0000)]
FIX: IPsec TNL test should load plugins
Change-Id: I76f643bebec9fd4988478ce0766621fbb6f71fff
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Thu, 13 Jun 2019 14:58:30 +0000 (16:58 +0200)]
SetupFramework: log thread error to console
Because logger.error from a non-main thread is lost.
+ Increase verbosity of virtualenv exception.
+ Introduce LocalExecution.py library.
+ Include multiple other style improvements.
+ Add some ssh.py improvements:
+ Accept also commands of OptionString type.
+ Introduce a limited form of raise_from for exception chaining.
+ Add include_reason argument to exec_cmd_no_error.
Change-Id: I0cd92bcdaa1a5c4cc20cb99067593fc3b40d2c31
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Thu, 20 Jun 2019 12:39:09 +0000 (13:39 +0100)]
perf ipsec: test renaming
Change-Id: Ieacefc7d19438d622ef8e23e9504d80e2a34215f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Yulong Pei [Wed, 19 Jun 2019 14:47:46 +0000 (22:47 +0800)]
Add 2n-dnv and 3n-dnv configuration to bootstrap-verify-perf.sh
Change-Id: I90427de5b611e432e5e46ab8758a31e376215914
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Tibor Frank [Wed, 19 Jun 2019 12:14:10 +0000 (14:14 +0200)]
Add continue/fail option for enable traces
Change-Id: I675f9664391c9f18f312773812f765f345983cc1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 19 Jun 2019 14:31:43 +0000 (16:31 +0200)]
Trending: Reduce the number of input files
Change-Id: I37fdd6c01a8e25ecc0353118db3c8e18d848c890
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 3 Jun 2019 10:55:55 +0000 (12:55 +0200)]
VAT-to-PAPI: VPPCounters
Change-Id: I5954fdd61ead9b4143f8cc4e20294cf8e199e0af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 11 Jun 2019 12:38:06 +0000 (14:38 +0200)]
VAT-to-PAPI: NATUtil
Change-Id: Id64bbf899e78c7c55410a8ce608393c22fa596ab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 30 May 2019 14:13:25 +0000 (16:13 +0200)]
CSIT-1459: Migrate IP libraries from VAT to PAPI
Change-Id: Id84cf9c3afd53260b5bbf658a6a3870aa0c91333
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 10 Jun 2019 10:49:51 +0000 (12:49 +0200)]
VAT-to-PAPI: VPPUtils
Change-Id: If4eb592e2718c4564f1f7929ca6ff91c02f074a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Yulong Pei [Tue, 18 Jun 2019 10:18:10 +0000 (18:18 +0800)]
Add 2-node and 3-node denverton to specifications
Change-Id: I79fc4a4d28e1ec1aaa6590c6df340fa7d33c8654
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Fri, 7 Jun 2019 09:45:41 +0000 (09:45 +0000)]
Add scale ipsec tunnel tests
- 5K
- 10K
Change-Id: Iaa2c77d07c3686e09fe327c663d7d7fc42024034
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Yulong Pei [Wed, 19 Jun 2019 09:30:59 +0000 (17:30 +0800)]
Add denverton servers to ansible lf_inventory hosts
Change-Id: Iac3ed425caa8f7c28546f04a6c4adc1f834bffd6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Vratko Polak [Tue, 18 Jun 2019 13:04:07 +0000 (15:04 +0200)]
Fix exit from reservation loop
Break from the while loop is on both success and no testbeds.
Change-Id: Iea368034927965c7f99f5502240bd768e3f62eec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 18 Jun 2019 12:17:07 +0000 (14:17 +0200)]
Continue reservation when cleanup fails
+ Only on not-failed-yet testbeds.
+ If any, else give up.
Change-Id: I3209507d3d57a77ef6afad3184ca25e098910311
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 14 Jun 2019 04:51:59 +0000 (06:51 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
19.08-rc0~
446-g3860a77~b7297
- use new vpp ref build - ubuntu 18.04:
19.08-rc0~
446-g3860a77e9
- use new vpp ref build - centos7:
19.08-rc0~446_g3860a77~b7181
Change-Id: I7a99f98c6805fb5ddc17d2f858a4af91ea700d25
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 10 Jun 2019 08:40:12 +0000 (10:40 +0200)]
PAPI: Reduce the amount of logged information
Change-Id: I5cfd19a9ecca6891232d92d232a159422c0a835e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 13 Jun 2019 12:29:14 +0000 (14:29 +0200)]
Add more tests to daily jobs
+ Add baseline tests for all NICs, only min size.
+ Add scale tests for x710 NIC, only min size and without 4c.
New test counts:
csit-vpp-perf-mrr-daily-master-2n-skx: 96
csit-vpp-perf-mrr-daily-master-3n-skx: 211
csit-vpp-perf-mrr-daily-master: 223
Change-Id: I14c0699dd8277b6e59cdfa3e41585f50ec75dd29
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 17 Jun 2019 07:42:43 +0000 (09:42 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: Ieb6537c1e1c1b7e0ca4f7ec490a9f0bd379030e9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 17 Jun 2019 07:37:30 +0000 (09:37 +0200)]
Report 1904: Configure rls 1904.25
Change-Id: I44bfc2247d4d2def131d89e1d97d8cad7522ccd1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 14 Jun 2019 20:36:41 +0000 (20:36 +0000)]
FIX: IPsec TNL mode func
Change-Id: I4fdcf48d8c60d728b0fe1b44baf0d2042185dd42
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Fri, 14 Jun 2019 08:30:40 +0000 (10:30 +0200)]
Add hsw drivers to topology and check against AVF
Change-Id: Ifcc1dcdb3a0b4a7c62e4a41e5b3d016b276e93be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 12 Jun 2019 10:28:45 +0000 (12:28 +0200)]
Add comments for some tag exclusions
Change-Id: I9daa70e433a2942d29c4e64856cb76d31f94a6f3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Fri, 14 Jun 2019 15:41:42 +0000 (15:41 +0000)]
FIX: IPsec TNL mode
Change-Id: Ide82ae5fa03d3fec8f4db9db7634be0a1e339cd1
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 14 Jun 2019 15:00:17 +0000 (15:00 +0000)]
FIX: IPsec INT mode
Change-Id: I286490280b6e62f9f212831a5bf1d14db1838fa7
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Fri, 14 Jun 2019 06:31:18 +0000 (08:31 +0200)]
PAPI: Fix PyLint errors
Change-Id: Ieaafbb111f4c3aea9b577c2ab31ca5162400ac46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 14 Jun 2019 06:04:44 +0000 (06:04 +0000)]
FIX: IPsec Functional teardown
Change-Id: If63d6815b4e0e9ed426e3bae8008635d9690c4a6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Tue, 4 Jun 2019 00:56:14 +0000 (02:56 +0200)]
virl: re-distribute test suites to virl simulations
Change-Id: I7758d888f1a5edc42cba3c6131b8c882e709dc91
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 12 Jun 2019 06:05:23 +0000 (08:05 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: If0e75e4bb4623eea913d433affa42a6bb03454b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Sun, 9 Jun 2019 06:44:04 +0000 (06:44 +0000)]
vpp_device: TAP
Change-Id: Ife31921daaa5a87f64e61d2eebb98bfdded1dc76
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 7 Jun 2019 13:44:52 +0000 (13:44 +0000)]
vpp_device: IPsec
- Remove VM ipsec tests as they are not interesting
- Remove duplicate (vpp_device/virl) VM tests
- Remove VM tunnel tests and use base tunnel (we do not need tunnel and VM)
Change-Id: I5d7b6d8a037878f81a6bdc0114af481b32141dde
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 10 Jun 2019 10:14:46 +0000 (12:14 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: Ia75675d6e89902c3370feaa2e8eb468cdd0fdba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 10 Jun 2019 10:08:21 +0000 (12:08 +0200)]
Report: Configure report 1904.24
Change-Id: I4d6d913f0139fe0fab00668ec16081c04cc6bc0e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 6 Jun 2019 12:19:59 +0000 (12:19 +0000)]
Python3: TRex driver
Change-Id: I25f7598b52c87ec1a2d4c6f22680d5200b583e2c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sun, 9 Jun 2019 05:59:57 +0000 (05:59 +0000)]
FIX: Disable AVF on 3n-hsw
Change-Id: Id7c81a92dd50db365c219529a687fa37fd05ceb3
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 6 Jun 2019 12:16:12 +0000 (12:16 +0000)]
CSIT-1521 Convert NestedVM testcase into KernelVM
Change-Id: Ic493253dc29dad4fc7e6541e4b839ca5898a6a40
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Thu, 6 Jun 2019 10:33:20 +0000 (12:33 +0200)]
Simplify mrr daily tag expression
The number of tests executed is intentionally smaller,
as recently the runtime has gone up too much.
New numbers:
csit-vpp-perf-mrr-daily-master: 120
csit-vpp-perf-mrr-daily-master-2n-skx: 72
csit-vpp-perf-mrr-daily-master-3n-skx: 126
More details included as diff files.
+ Less per-testbed exceptions.
- Single/double links tags still set at two places.
Change-Id: I1149d3e52edf38c7d9d3e0160c533e35ae944d0d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 5 Jun 2019 11:36:38 +0000 (13:36 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I54b2f02745497ea4cd90d485834b1aa42389f57d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 5 Jun 2019 08:59:37 +0000 (08:59 +0000)]
FIX: OS detection
Change-Id: I3ba6c7dc6a72e376419990ce7f5acc8d373f246f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Thomas F Herbert [Sat, 18 May 2019 19:12:52 +0000 (15:12 -0400)]
CSIT changes to support new Centos 7 device testing container image.
CSIT-1505
Parse {os} parameter from job and use it to separate the correct
image for each distro and the correct stable package versions.
Use two vpp device image names, one for Ubuntu and one for Centos.
Centos sut image is in https://hub.docker.com/r/snergster/csit-sut-centos
Source for Centos sut image:
https://github.com/snergfdio/multivppcache/tree/master/csit-sut-centos
Change-Id: I568c82710d730c4ed0ca25bc12cb6074e1cbe27e
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
Peter Mikus [Wed, 5 Jun 2019 06:52:37 +0000 (06:52 +0000)]
Remove intrusive useless logging
Change-Id: Ib633266daaf67f257867f5ba0b2836f777ecd3bf
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 24 May 2019 18:16:41 +0000 (18:16 +0000)]
Even more Crypto combinations
Change-Id: I10eeb4ee30a57712824e68176d92d1ecb5f0d1b0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Tue, 4 Jun 2019 13:22:17 +0000 (15:22 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I8609ecd45a634fccf3e721beac5a0ec640f704db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 16 May 2019 11:47:50 +0000 (13:47 +0200)]
VAT-to-PAPI: memif
Change-Id: I9e3f1a2a2a1c11a355cd66c940beb663ecc7d7a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Michal Cmarada [Tue, 4 Jun 2019 09:53:38 +0000 (11:53 +0200)]
fix Honeycomb failing tests
- due to VAT to PAPI migration some tests
need to be updated
- fixed HC tests: ACL, Interfaces/SubInterfaces, Tap
Vhost, Vxlan, Vxlan-gpe
Change-Id: I9adad041a619b48057bdda388becd53dde484483
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
Tibor Frank [Mon, 3 Jun 2019 07:23:15 +0000 (09:23 +0200)]
VAT-to-PAPI: ContainerUtils
Change-Id: Id186c3c280a6b876b8212e01b261ad8c65e5f40c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 30 May 2019 13:18:31 +0000 (15:18 +0200)]
VAT-to-PAPI: VhostUser
Change-Id: I235d4654b04275877b3c5f4cf49ef5755c3f4985
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 30 May 2019 13:02:09 +0000 (15:02 +0200)]
Add possibility to use other then default NIC per VPP patch
Change-Id: I25e51022e0ec961fce444bc8f0f4413d0e95d7eb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Sat, 1 Jun 2019 12:21:27 +0000 (14:21 +0200)]
Update of VPP_STABLE_VER files
- use new vpp ref build - ubuntu 16.04:
19.08-rc0~
341-gb19bf8d~b7191
- use new vpp ref build - ubuntu 18.04:
19.08-rc0~
341-gb19bf8de1
- use new vpp ref build - centos7:
19.08-rc0~341_gb19bf8d~b7065
Change-Id: I62b61b8d91dce90dfd241d8325b0049c1c02b6a9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 3 Jun 2019 10:25:20 +0000 (12:25 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I514dbd61dc22736fb3925d6d3cec767d0f4f84a8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 3 Jun 2019 10:16:35 +0000 (12:16 +0200)]
Report: Configure Report 1904.23
Change-Id: I0f19d4e3bdafbdf1a435436a2f25945c2b45e06e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 31 May 2019 09:25:50 +0000 (09:25 +0000)]
Add meltdown spectre to calibration set
+ Fix the version of MMD tool to always latest
Change-Id: Iafd7f40d618b8e4995b5cc12fe06056719f58517
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 18 Mar 2019 12:30:11 +0000 (13:30 +0100)]
CSIT-1468: InterfaceUtil migration from VAT to PAPI
Change-Id: I0062710d58996be767a852dc00545fedd60a5c72
Signed-off-by: Jan Gelety <jgelety@cisco.com>
juraj.linkes [Wed, 29 May 2019 09:02:42 +0000 (11:02 +0200)]
Fix args order in setup_node call
Change-Id: I484cda8c8410e2f38d68da82761b1154dda26b1c
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
juraj.linkes [Fri, 24 May 2019 08:58:52 +0000 (10:58 +0200)]
Use threads for fw setup and cleanup
Using multiprocessing sometimes causes scp to hang when copying files.
Threading is also more lightweight.
Change-Id: I047b4835bbf1584c80469b27af5394d89087e8a9
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
Peter Mikus [Tue, 28 May 2019 06:51:12 +0000 (06:51 +0000)]
FIX: Trex 2.54 resolve issue.
Change-Id: I8ffb360411fe5a0304ba7568828588dc7cfad267
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Tue, 28 May 2019 07:15:34 +0000 (09:15 +0200)]
CSIT-1488: Add data to the Report 1904
- remove 'NIC_Cisco-VIC-1385' and '9000B' from vpp perf full
Change-Id: Ic3d6a035945eddf6a5f5c73a62ca872a59c18b46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Michal Cmarada [Mon, 27 May 2019 11:58:23 +0000 (13:58 +0200)]
HC2VPP-411: migrate interfaces-state to interfaces
- new ietf-interfaces makes interfaces-state obsolete
- updates honeycomb tests to latest ietf-interfaces model
Change-Id: I5502a5ab23661429caca9498407d7121d423a1a3
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
Jan Gelety [Thu, 23 May 2019 07:45:01 +0000 (09:45 +0200)]
FIX: do not generate 9000B perf test in case of vic1385 nic
Change-Id: I7b8e30903a8bc012a3bb43bfb33755e08b56dc1d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 27 May 2019 08:56:53 +0000 (10:56 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: If23ed1d2a8b716a2c145a8b13ebc91c9925284d8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 5 Feb 2019 09:20:41 +0000 (10:20 +0100)]
CSIT-1425 Upgrade TRex to v2.54
Change-Id: I71010c18210e88828ded0bc679997d76f34886cb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Fri, 24 May 2019 07:33:58 +0000 (09:33 +0200)]
Report: Configure Report 1904.22
Change-Id: Ic8d5a9a856658a2a2661cae8abd8d3b1127b4ff8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 24 May 2019 07:29:59 +0000 (09:29 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I23224cba405ad905b65799682f59de126d88bc2b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Thu, 23 May 2019 07:23:22 +0000 (07:23 +0000)]
FIX: IPsec typo
Change-Id: Ic565a5caea57b05e6905698f68fcf2146ae14d72
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Fri, 17 May 2019 13:08:13 +0000 (15:08 +0200)]
PAL: Add IPSEC to mapping table
- waiting for https://gerrit.fd.io/r/19677
- waiting for https://gerrit.fd.io/r/19710
Change-Id: I1c4a09ded8402d9ce60e021414ce7f46781526b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 20 May 2019 09:56:19 +0000 (09:56 +0000)]
CSIT-1507: Rework IPsec base testcases
Change-Id: Ifb65ad8da9c5b1ef10a65a5174b698f86d2dc9d9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 17 May 2019 12:17:06 +0000 (12:17 +0000)]
CSIT-1506: Rework IPsec base testcases
- Add:
aes-128-gcm aes-128-gcm
aes-256-gcm aes-256-gcm
aes-128-cbc hmac-sha-256
aes-256-cbc hmac-sha-512
- Remove:
hmac-sha1
- Scale will follow in next patch
Change-Id: I789f71cf66cf61b8dbb3c6dbe9b6fdc79866ac33
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 22 May 2019 09:35:56 +0000 (09:35 +0000)]
Re-enable T22 into pool
- Server reinstalled via cobbler
Change-Id: Ic0d45f0b874059af2568d6483517107924a7c66a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 22 May 2019 10:41:05 +0000 (12:41 +0200)]
Report: Update report history
Change-Id: I790f5d658472d087cd33b6a08a55620e3e5906e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 22 May 2019 10:35:42 +0000 (12:35 +0200)]
Report: Fix missing func and vpp_device data
Change-Id: Id21e52262904baa9a940e5680a413a1f5ae06b8b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Sat, 23 Feb 2019 16:27:07 +0000 (16:27 +0000)]
Ansible: Add CIMC/IPMI/COBBLER
- added tasks and handlers for CIMC, IPMI, COBBLER
- allows provisioning of servers via COBBLER
Change-Id: I64080069260dabb8a6e3b648aeff12f109d3f7c2
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 22 May 2019 07:59:18 +0000 (09:59 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I3af37de91450a4ac11eb6e6e8cd271de41e985bf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 21 May 2019 08:34:30 +0000 (10:34 +0200)]
Exclude IPSECHW tests on NICs other than xl710
The next version of suite generator will avoid generating them,
for now we just exclude by a tag expression.
Change-Id: I68c80c412ea327c11366f539b10de19df50152c2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Thomas F Herbert [Sun, 19 May 2019 21:17:51 +0000 (17:17 -0400)]
Update Centos VIRL image to version 2.5
Update CentOS release.
Add python34.
Change-Id: Ie0a11810c5b120cfd170dc4eaf3e72bbd3155d4a
Signed-off-by: Thomas F Herbert <therbert@redhat.com>
Tibor Frank [Tue, 21 May 2019 14:45:37 +0000 (16:45 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I6c6f478a0dc54a10e4b7568dc86aa883e896e28a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 20 May 2019 12:04:16 +0000 (14:04 +0200)]
FIX2: VTS cpu list
Change-Id: Ibd0f719585d6482a65ae6cea516a4da017281ef5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 20 May 2019 12:20:42 +0000 (14:20 +0200)]
Report: Remove (IPSECHW and x520) tests from report
Change-Id: I1481cd889aab7cc1f8d6b7c3a3cd5e96e955bb8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 20 May 2019 10:55:59 +0000 (12:55 +0200)]
FIX: VTS cpu list
Change-Id: Ic3ac22642e443f30a46914c18cd9a9b54064286b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 20 May 2019 08:31:19 +0000 (10:31 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I632ed9e00feb26b734f86bfe75dca9e14ac57f0c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 17 May 2019 12:54:20 +0000 (14:54 +0200)]
Report: Fix internal links to PLRsearch methodology
Change-Id: I87b334e9c89b1469112dac4327faaf430c6f846a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 17 May 2019 10:42:19 +0000 (12:42 +0200)]
Report: table_soak_vs_ndr
Change-Id: Ia313fb43c315990212501b4139f3f1f7bc9d67f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 16 May 2019 15:01:21 +0000 (17:01 +0200)]
Reduce the number of tests loops in virl timed jobs
- with current number of test loops jobs fail with timeout
Change-Id: Id08cd1a9221eda116e018a44bece68a494286169
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 17 May 2019 08:22:45 +0000 (10:22 +0200)]
Trending: Reduce input data
Change-Id: Ib540a687a0b8b27584f6d8c571cfd453122f0f91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 17 May 2019 07:28:20 +0000 (09:28 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: Ic693d6750007727b6e773e17f8f2fba2f96c2c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 15 May 2019 15:58:24 +0000 (17:58 +0200)]
Report soak comparison: Add stdev for delta
Change-Id: Ibbff3c123afac2e68caf33f3ccd5fc4909509917
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 16 May 2019 08:55:00 +0000 (10:55 +0200)]
Tests: Add IPSEC SW scale tests
Change-Id: I4339059a0cf67acce668abe42aab59bbb17916d9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 14 May 2019 08:51:15 +0000 (10:51 +0200)]
Avoid !r format appending u on unicode
Change-Id: I2c0877f4d8b6cad2694c43a4350998cd2b830680
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 16 May 2019 11:17:34 +0000 (11:17 +0000)]
FIX: IPsec selection backend.
Change-Id: Ie4acaecf60e03fc4e843e29d8222fbf2f00bbf44
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 14 May 2019 14:39:56 +0000 (14:39 +0000)]
Make topology files read dynamically from directory
Change-Id: Id43c7c299d2e112b6caf00a3d340e6051ab337b6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Thu, 16 May 2019 08:43:31 +0000 (10:43 +0200)]
Improve soak graphs and content
+ Fix duration, mention number of tests and runs.
- Hover information still feels wrong.
+ Mention "critical rate" instead of "throughput" where possible.
+ Mention lower bounds are displayed.
+ Rename "plrsearch_algorithm" label to "PLRsearch".
+ Because the previous link did not work. Due to underscore?
+ Rename "SOAK" to "soak" or "Soak" (except when it is a tag).
Change-Id: I9c079f8c2e93d96249d4b60893469c9257d4f3db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 16 May 2019 08:27:03 +0000 (10:27 +0200)]
CSIT-1488: Add data to the Report 1904
Change-Id: I7484eeb872cd8fa736421a0ded2fcfffe733051e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 16 May 2019 06:42:59 +0000 (08:42 +0200)]
Report: Configure 1904.21
Change-Id: Ib65580067d9c41137293036bbd786e31c2bdf503
Signed-off-by: Tibor Frank <tifrank@cisco.com>