csit.git
5 years agoFIX: SetupFramework to detect failures 18/13218/7
Peter Mikus [Tue, 26 Jun 2018 08:45:06 +0000 (08:45 +0000)]
FIX: SetupFramework to detect failures

- Fix behavior of setup framework to properly detect and raise
exception in case of any issue occurs during framework setup on any node
- General code cleanup

Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoSmall update to PXE installation README 16/13216/1
Peter Mikus [Tue, 26 Jun 2018 05:16:49 +0000 (05:16 +0000)]
Small update to PXE installation README

Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate PXE info about new Skylake machines 04/13204/1
Peter Mikus [Mon, 25 Jun 2018 12:07:17 +0000 (12:07 +0000)]
Update PXE info about new Skylake machines

Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 00/13200/2
Jan Gelety [Mon, 25 Jun 2018 07:42:19 +0000 (09:42 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~394-ge0d2bd6~b4508

- use new vpp ref build - centos7:
  18.07-rc0~394_ge0d2bd6~b4435

Change-Id: I3b1a749cf4192321af9ec1e9d297b938092d4135
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: use correct path to vpp build packages in weekly bootstrap 01/13201/2
Jan Gelety [Mon, 25 Jun 2018 08:04:31 +0000 (10:04 +0200)]
FIX: use correct path to vpp build packages in weekly bootstrap

Change-Id: I5a92499cc7f1e475614126fcb6044d48615673ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1043: Execute pci rescan only if needed 61/12961/10
juraj.linkes [Fri, 8 Jun 2018 08:47:27 +0000 (10:47 +0200)]
CSIT-1043: Execute pci rescan only if needed

Pci rescan is a rather invasive process, which is why it should be
executed only if needed. This patch moves the pci rescan after
pci device driver discovery, rescanning the devices for further attemps
at driver discovery.

Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoFix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-func 72/13172/2
Michal Cmarada [Thu, 21 Jun 2018 08:17:40 +0000 (10:17 +0200)]
Fix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-func

Add wait for interface to be up, because it
takes some time while the interface state changes.

Change-Id: I895dea1017ac0ffd099e80d9edca0f1d127657dd
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoHC2VPP-331: Fix Honeycomb fails to assign VRF to interface 20/13120/4
Michal Cmarada [Thu, 21 Jun 2018 07:53:08 +0000 (09:53 +0200)]
HC2VPP-331: Fix Honeycomb fails to assign VRF to interface

- add configuration for FIB table management to test suite
- fix routing test suite HC2VPP-331 bugs
- fix intip4-intip6 test suite HC2VPP-331 bugs

Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoCSIT-1136: Trending: Redirect "new" to the index.html 70/13170/1
Tibor Frank [Thu, 21 Jun 2018 07:59:54 +0000 (09:59 +0200)]
CSIT-1136: Trending: Redirect "new" to the index.html

 - remove the code which generated redirection

Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1136: Trending: Redirect "new" to the index.html 65/13165/2
Tibor Frank [Thu, 21 Jun 2018 05:26:27 +0000 (07:26 +0200)]
CSIT-1136: Trending: Redirect "new" to the index.html

Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: PAL - list of failed tests 56/13156/1
Tibor Frank [Wed, 20 Jun 2018 13:21:47 +0000 (15:21 +0200)]
FIX: PAL - list of failed tests

Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Replace old trending with the new one 45/13145/1
Vratko Polak [Wed, 20 Jun 2018 10:56:41 +0000 (12:56 +0200)]
CSIT-1110: Replace old trending with the new one

+ Remove /new/ folders in presentation and docs.

Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRevert "CSIT-986: Use MLRsearch from pip" 36/13136/2
Peter Mikus [Wed, 20 Jun 2018 06:09:32 +0000 (06:09 +0000)]
Revert "CSIT-986: Use MLRsearch from pip"

This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb.

Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd.

1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead

2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit

3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed

Next time please think or consult with more seniored csit core developer
Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge.
Possible solution:
1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own

Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 27/13127/3
Jan Gelety [Tue, 19 Jun 2018 14:30:14 +0000 (16:30 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~358-ga5ee900~b4457

- use new vpp ref build - centos7:
  18.07-rc0~358_ga5ee900~b4395

- use new dpdk version:
  18.02.1-vpp2

Change-Id: Idc72e3a01dbb1b479a4a9b6404c4b01d5a7c4627
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1110: Improve new detection methodology doc 11/13011/9
Vratko Polak [Thu, 14 Jun 2018 12:03:44 +0000 (14:03 +0200)]
CSIT-1110: Improve new detection methodology doc

Change-Id: I068fd4e9418f232ee1e1f13994e9c5c431478ec8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUse pkg download script in bootstrap files 28/11928/39
Peter Mikus [Thu, 19 Apr 2018 12:52:50 +0000 (14:52 +0200)]
Use pkg download script in bootstrap files

Download specific version of VPP/DKMS via download script.

Change-Id: I6585790224d746a9edea7fa6624e810f389218e6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1133: Cosmetic improvements in trending plots 17/13117/3
Tibor Frank [Tue, 19 Jun 2018 08:46:42 +0000 (10:46 +0200)]
CSIT-1133: Cosmetic improvements in trending plots

 - Remove "outlier" from the colorbar
 - Remove anomalies from the legend

Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-986: Use MLRsearch from pip 97/13097/2
Vratko Polak [Mon, 18 Jun 2018 14:00:06 +0000 (16:00 +0200)]
CSIT-986: Use MLRsearch from pip

+ Delete resources/libraries/python/search/.
+ Add MLRsearch==0.1.1 to requirements.txt.
+ Bump PyPI/MLRsearch version to 0.1.2.

Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1126: Detection and reporting of failed MRR tests 28/13028/20
Tibor Frank [Wed, 13 Jun 2018 13:19:18 +0000 (15:19 +0200)]
CSIT-1126: Detection and reporting of failed MRR tests

Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-986: Implement proposed MDR improvements 61/12761/10
Vratko Polak [Mon, 28 May 2018 09:53:45 +0000 (11:53 +0200)]
CSIT-986: Implement proposed MDR improvements

+ Use first intermediate with goal in initial phase.
+ Measure above MRR if that got zero loss.
+ Always prioritizes NDR in internal search.
+ Rename classes.
+ Copy code for standalone PyPI publishing.
- Original files will be deleted after publish.

Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Update code after jumpavg 0.1.2 release 91/13091/1
Tibor Frank [Mon, 18 Jun 2018 06:10:54 +0000 (08:10 +0200)]
CSIT-1110: Update code after jumpavg 0.1.2 release

+ Use the released version in PAL.
+ Bump the jumpavg source to 0.1.3 for next release.
+ Add PyPI/owners.txt to track python package owner group.

Change-Id: I29284a258b24f9991379719313f30cce0349c2bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate Ansible with new Skylake machines 86/13086/2
Peter Mikus [Fri, 15 Jun 2018 12:29:07 +0000 (12:29 +0000)]
Update Ansible with new Skylake machines

Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1085 eth-l2xcbase-eth-1memif-1dcr 14/12614/21
Peter Mikus [Thu, 17 May 2018 07:51:35 +0000 (09:51 +0200)]
CSIT-1085 eth-l2xcbase-eth-1memif-1dcr

Test case definitions

Change-Id: I03736ef003d3839859dc450745323362b21aa75e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoRevert "CSIT-1110: Update code after jumpavg 0.1.2 release" 84/13084/1
Tibor Frank [Fri, 15 Jun 2018 12:02:22 +0000 (12:02 +0000)]
Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"

This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8.

Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Update code after jumpavg 0.1.2 release 76/13076/1
Vratko Polak [Fri, 15 Jun 2018 11:19:57 +0000 (13:19 +0200)]
CSIT-1110: Update code after jumpavg 0.1.2 release

+ Use the released version in PAL.
+ Bump the jumpavg source to 0.1.3 for next release.
+ Add PyPI/owners.txt to track python package owner group.

Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Use jumpavg library from pip 38/13038/5
Vratko Polak [Thu, 14 Jun 2018 12:04:03 +0000 (14:04 +0200)]
CSIT-1110: Use jumpavg library from pip

+ Move the jumpavg library code to separate directory.
- Bump to 0.1.2 has to be done later.

Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Add files for PyPI migration 36/13036/3
Vratko Polak [Wed, 13 Jun 2018 15:18:05 +0000 (17:18 +0200)]
CSIT-1110: Add files for PyPI migration

Change-Id: I3414d4391f339ee67066491382b59239a81db241
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Prepare for migrating the new detection 35/13035/3
Vratko Polak [Wed, 13 Jun 2018 11:04:01 +0000 (13:04 +0200)]
CSIT-1110: Prepare for migrating the new detection

+ Do not declare BitCountingClassifier.classify() as class method.
+ Make BitCountingGroupList subclass of list.
+ Inherit from abstract classes whenever possible.
+ Drop unneeded imports.
+ Add module docstrings and class docstrings anywhere.
+ Add TODOs hinting at possible improvements.

Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-PERF: New trigger design 25/13025/12
Peter Mikus [Wed, 13 Jun 2018 12:09:47 +0000 (12:09 +0000)]
CSIT-PERF: New trigger design

- CSIT-1128
- This patch is implementing processing of TAGS specified
as part of commit message

Change-Id: Iad0923d22fae369dfe923a917e1c0d47d5cbf656
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TAG processing 33/13033/1
Peter Mikus [Wed, 13 Jun 2018 14:34:06 +0000 (14:34 +0000)]
FIX: TAG processing

Change-Id: I08815de519532e8a20873f8b172d3f42ccfa33fb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TAG processing 26/13026/4
Peter Mikus [Wed, 13 Jun 2018 12:25:51 +0000 (12:25 +0000)]
FIX: TAG processing

- Improve TAG post processing

Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-942: RCA - Option 1: Analysing Archived VPP Results 00/11400/5
Tibor Frank [Tue, 27 Mar 2018 12:37:42 +0000 (14:37 +0200)]
CSIT-942: RCA - Option 1: Analysing Archived VPP Results

 - CSIT-953: LLD

Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Fix dashboard anomaly count range 19/13019/1
Vratko Polak [Wed, 13 Jun 2018 08:23:06 +0000 (10:23 +0200)]
CSIT-1110: Fix dashboard anomaly count range

+ Dashboard tables should now report anomalies from last week only.
+ Changed handling of Nan to report regression.

Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agolink for start-testcase-DMM 88/12988/3
sharath [Mon, 11 Jun 2018 12:21:49 +0000 (17:51 +0530)]
link for start-testcase-DMM

Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
5 years agoCSIT-1110 PAL: Fix warnings by moving new docs 06/13006/1
Vratko Polak [Tue, 12 Jun 2018 12:55:42 +0000 (14:55 +0200)]
CSIT-1110 PAL: Fix warnings by moving new docs

Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110 PAL: Use group averages for term changes 92/12992/2
Vratko Polak [Mon, 11 Jun 2018 16:45:20 +0000 (18:45 +0200)]
CSIT-1110 PAL: Use group averages for term changes

+ Apply only to trending dashboard tables.
+ Remove outlier column.
- Dashboard description not updated yet.

Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoMask out LBOND_DPDK tags from per patch verification 98/12998/1
Peter Mikus [Tue, 12 Jun 2018 08:54:08 +0000 (08:54 +0000)]
Mask out LBOND_DPDK tags from per patch verification

Change-Id: I47a5261e9a9b590a408bda093a9310dc38c85873
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1110: Cherry-pick edits into new detection 86/12986/2
Vratko Polak [Mon, 11 Jun 2018 12:47:50 +0000 (14:47 +0200)]
CSIT-1110: Cherry-pick edits into new detection

+ Edit methodology documentation.

Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Integrate anomaly detection into PAL 55/12855/8
Vratko Polak [Fri, 8 Jun 2018 16:07:35 +0000 (18:07 +0200)]
CSIT-1110: Integrate anomaly detection into PAL

+ Keep the original detection,
+ add the new one as subdirectory
  (both in source and in rendered tree).
- The new detection is not rebased over "Add dpdk mrr tests to trending".

New detection features:
+ Do not remove (nor detect) outliers.
+ Trend line shows the constant average within a group.
+ Anomaly circles are placed at the changed average.
+ Small bias against too similar averages.
+ Should be ready for moving the detection library out to pip.

Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Add link to testbed HW specification. 81/12981/2
Tibor Frank [Mon, 11 Jun 2018 06:05:31 +0000 (08:05 +0200)]
Trending: Add link to testbed HW specification.

Change-Id: Ib000f2146bf0612b88c605413108b22fa4a99210
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1116: Add dpdk mrr tests to trending 86/12886/25
Tibor Frank [Tue, 5 Jun 2018 10:25:32 +0000 (12:25 +0200)]
CSIT-1116: Add dpdk mrr tests to trending

 - Add static content
 - Add models to specification
 - Add plots
 - Add dpdk tests to dashboard
 - Add dpdk to csv and pretty ASCII tables
 - Get DPDK version from output.xml

Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1114 Add DPDK download to bootstrap 60/12960/8
Peter Mikus [Fri, 8 Jun 2018 05:59:48 +0000 (05:59 +0000)]
CSIT-1114 Add DPDK download to bootstrap

- Add downloading artifacts to bootstrap to be able to use latest dpdk version

Change-Id: I5f07e8207780b81ad85b6053db99639c47448409
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1081 Container VPP configuration refactor 64/12564/18
Peter Mikus [Mon, 14 May 2018 11:22:42 +0000 (13:22 +0200)]
CSIT-1081 Container VPP configuration refactor

Adopt code for various topology configurations.

Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd DPDK IMIX tests to trending 57/12957/1
Tibor Frank [Fri, 8 Jun 2018 04:32:36 +0000 (06:32 +0200)]
Add DPDK IMIX tests to trending

Change-Id: Ibacb08a72b939346c90489282b10ebc001446f4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1122: Add link bonding tests for x710 to the Trending 41/12941/1
Tibor Frank [Thu, 7 Jun 2018 12:15:26 +0000 (14:15 +0200)]
CSIT-1122: Add link bonding tests for x710 to the Trending

Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1121: Add "Get DPDK version" KW to DPDK tests 29/12929/5
Tibor Frank [Thu, 7 Jun 2018 08:03:17 +0000 (10:03 +0200)]
CSIT-1121: Add "Get DPDK version" KW to DPDK tests

Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 85/12885/2
Jan Gelety [Tue, 5 Jun 2018 07:59:37 +0000 (09:59 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~278-gb2371c2~b4361_amd64

- use new vpp ref build - centos7:
  18.07-rc0~278_gb2371c2~b4311.x86_64

Change-Id: Idbb5d2c01839d4bca5cfd4ee9b26788bd15d3905
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHC Tests: reenable NSH plugin (CSIT-994) 48/12848/3
Marek Gradzki [Fri, 1 Jun 2018 10:58:15 +0000 (12:58 +0200)]
HC Tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/12572/

Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1115: Add dpdk mrr tests 84/12884/5
Tibor Frank [Tue, 5 Jun 2018 07:48:24 +0000 (09:48 +0200)]
CSIT-1115: Add dpdk mrr tests

Change-Id: Ib9d060f7e0d476b79debc750409da5277478e5b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: fix 90/12890/1
Tibor Frank [Tue, 5 Jun 2018 11:32:47 +0000 (13:32 +0200)]
Trending: fix

Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix 88/12888/1
Tibor Frank [Tue, 5 Jun 2018 11:10:28 +0000 (13:10 +0200)]
Trending: Fix

Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Print NameError to reduce confusion 49/12849/3
Vratko Polak [Mon, 4 Jun 2018 13:33:10 +0000 (15:33 +0200)]
CSIT-1110: Print NameError to reduce confusion

See https://gerrit.fd.io/r/12724
for an example mistake which also can cause NameError.

Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1112: Add link bonding tests to the Trending 40/12840/3
Tibor Frank [Fri, 1 Jun 2018 09:17:22 +0000 (11:17 +0200)]
CSIT-1112: Add link bonding tests to the Trending

Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd DPDK MRR weekly into bootstrap 70/12870/2
Peter Mikus [Mon, 4 Jun 2018 06:11:46 +0000 (06:11 +0000)]
Add DPDK MRR weekly into bootstrap

Change-Id: Ia8c62035afe4178f1967cc1683afed7476186f7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoVPP link bonding - lacp mode 23/12623/24
Jan Gelety [Thu, 17 May 2018 12:31:43 +0000 (14:31 +0200)]
VPP link bonding - lacp mode

CSIT-1072
CSIT-1083
CSIT-1084

Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHC Tests: disable failing ACL ODL tests (HC2VPP-337) 23/12823/2
Marek Gradzki [Thu, 31 May 2018 06:38:25 +0000 (08:38 +0200)]
HC Tests: disable failing ACL ODL tests (HC2VPP-337)

Change-Id: I1fa3e3876bcc0b4f5e9908cb4f6920d49eb6dd45
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1055: Pkg download script to use package system not curl 84/12484/7
Peter Mikus [Wed, 9 May 2018 06:50:10 +0000 (08:50 +0200)]
CSIT-1055: Pkg download script to use package system not curl

- Rework VPP package download script

Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325) 11/12811/2
Marek Gradzki [Wed, 30 May 2018 15:07:29 +0000 (17:07 +0200)]
HC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325)

Adapts HC tests to
https://gerrit.fd.io/r/#/c/12810/

Change-Id: I6783b2db061c4cde0942dbb8583e7af8687c54d3
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoAdd s17-t33-tg1 into ansible/pxe 24/12824/2
Peter Mikus [Thu, 31 May 2018 06:39:45 +0000 (06:39 +0000)]
Add s17-t33-tg1 into ansible/pxe

Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoDPDK link bonding: xor mode 37/12537/33
Jan Gelety [Fri, 11 May 2018 08:36:41 +0000 (10:36 +0200)]
DPDK link bonding: xor mode

CSIT-1073
CSIT-1074
CSIT-1077

Change-Id: I248e079021c30988210fd792b32d5afdca71aadb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1068 Update testbed-setup for new server onboarding 22/12622/10
Peter Mikus [Thu, 17 May 2018 12:31:50 +0000 (14:31 +0200)]
CSIT-1068 Update testbed-setup for new server onboarding

Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1070 Update Ansible structure 60/12660/10
Peter Mikus [Sat, 19 May 2018 13:15:29 +0000 (15:15 +0200)]
CSIT-1070 Update Ansible structure

Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 88/12788/1
Jan Gelety [Tue, 29 May 2018 13:52:45 +0000 (15:52 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~252-g229c1aa~b4334_amd64

- use new vpp ref build - centos7:
  18.07-rc0~252_g229c1aa~b4285.x86_64

Change-Id: I596520740ed93e31617ee382108bcba269771423
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1089: Add SRv6 MRR tests to trending 39/12639/5
Tibor Frank [Fri, 18 May 2018 06:31:39 +0000 (08:31 +0200)]
CSIT-1089: Add SRv6 MRR tests to trending

Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1106: Unify the anomaly detection (plots, dashboard) 60/12760/5
Tibor Frank [Mon, 28 May 2018 07:02:35 +0000 (09:02 +0200)]
CSIT-1106: Unify the anomaly detection (plots, dashboard)

Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1104: Trending: Speed-up plots generation 36/12736/7
Tibor Frank [Fri, 25 May 2018 07:13:15 +0000 (09:13 +0200)]
CSIT-1104: Trending: Speed-up plots generation

Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC Tests: mark VRF assignment tests as failing (HC2VPP-331) 19/12719/2
Marek Gradzki [Thu, 24 May 2018 11:45:21 +0000 (13:45 +0200)]
HC Tests: mark VRF assignment tests as failing (HC2VPP-331)

Failures might be related to:
https://gerrit.fd.io/r/#/c/12643/

Change-Id: I0c60d51e27508f937a4b2d6c6b5e6f0703f793ab
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: mark unnumbered interface tests as failing (HC2VPP-330) 17/12717/2
Marek Gradzki [Thu, 24 May 2018 11:37:13 +0000 (13:37 +0200)]
HC Tests: mark unnumbered interface tests as failing (HC2VPP-330)

Failures might be related to:
https://gerrit.fd.io/r/#/c/12632/
and/or:
https://gerrit.fd.io/r/#/c/12646/

Change-Id: I529582ef95b6cf752a3f0e98cd0326d4a01d15a8
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoFIX: Trending dashboard 18/12718/2
Tibor Frank [Thu, 24 May 2018 11:37:53 +0000 (13:37 +0200)]
FIX: Trending dashboard

Change-Id: I7634a4074647ef226cd6fb3ac1b5e0ee5376c4d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1101: Optimize input data processing 62/12662/10
Tibor Frank [Mon, 21 May 2018 06:50:42 +0000 (08:50 +0200)]
CSIT-1101: Optimize input data processing

 - Add multiprocessing

Change-Id: Iaeb9dcf0f4523de379ecb7f775b941d9deb080b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd defaultbranch to .gitreview 90/12490/29
Vratko Polak [Wed, 9 May 2018 10:03:05 +0000 (12:03 +0200)]
Add defaultbranch to .gitreview

Without having different values in different branches,
"git review" has trouble contributing to non-master branches.

Change-Id: I4a6797a8646c26bdae49eb4fcc9dbd463b97ab7b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1087: Add SRv6 MRR tests 21/12621/11
Tibor Frank [Thu, 17 May 2018 12:17:20 +0000 (14:17 +0200)]
CSIT-1087: Add SRv6 MRR tests

Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd dot1q into L2-perf triggers 84/12684/2
Peter Mikus [Tue, 22 May 2018 08:08:06 +0000 (08:08 +0000)]
Add dot1q into L2-perf triggers

Change-Id: Idf91005bc1331705c9f5ac9a2b2af59a4fb5a062
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-986: Improve formatting of MDR documentation 79/12679/4
Vratko Polak [Mon, 21 May 2018 14:11:29 +0000 (16:11 +0200)]
CSIT-986: Improve formatting of MDR documentation

Change-Id: I1a67deea51b7ffdc7730a52b56f57baa64747d7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agostart-testcase-DMM file addition 97/12597/3
sharath [Wed, 16 May 2018 12:12:08 +0000 (17:42 +0530)]
start-testcase-DMM file addition

Change-Id: I39945a5f649571267361018659108d107ffb5149
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
5 years agoCSIT-986: MDR rst documentation 68/12268/36
Vratko Polak [Fri, 27 Apr 2018 17:57:13 +0000 (19:57 +0200)]
CSIT-986: MDR rst documentation

+ Introduction.
+ Phases description.
+ Comparison tables.
+ Graphs.

Change-Id: Iec5143770677c733070fb0444a1a7d898f1eb04e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoHC tests: fix 'Archive Honeycomb logs' KW docs 13/12613/2
Marek Gradzki [Thu, 17 May 2018 07:23:03 +0000 (09:23 +0200)]
HC tests: fix 'Archive Honeycomb logs' KW docs

Change-Id: I10851345579ee751b0b79b807fed140e4614685f
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC tests: fix log archive 12/12612/1
Marek Gradzki [Thu, 17 May 2018 07:17:54 +0000 (09:17 +0200)]
HC tests: fix log archive

Use 'Archive Honeycomb logs' instaed of Archive Honeycomb Logs.
The keyword was renamed by https://gerrit.fd.io/r/#/c/12578/

Change-Id: Ic0e2759637ecd0056b7accc3cd96bd8510a2ed14
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: fix CPU layout retrieval in the HC perf job 10/12610/2
Marek Gradzki [Thu, 17 May 2018 06:49:24 +0000 (08:49 +0200)]
HC Tests: fix CPU layout retrieval in the HC perf job

Change-Id: Id99e41a28d01e41d6fb51190d4ab86b667f828af
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086) 92/12592/5
Marek Gradzki [Wed, 16 May 2018 11:08:45 +0000 (13:08 +0200)]
HC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086)

Requires: https://gerrit.fd.io/r/#/c/12516/

Change-Id: Ie0a3452f51fb89914a6a0c53aa4136279a3dfb47
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoTrending: menu 00/12600/1
Tibor Frank [Wed, 16 May 2018 13:35:59 +0000 (15:35 +0200)]
Trending: menu

Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1082: Trending: Display date on the x-axis 93/12593/3
Tibor Frank [Wed, 16 May 2018 11:10:03 +0000 (13:10 +0200)]
CSIT-1082: Trending: Display date on the x-axis

Change-Id: I3f5bdb11222446a5c6016ab4ff57d909514c3ddc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-992: Fix intermediate phases MDR parameter 36/12536/8
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Fix intermediate phases MDR parameter

Also add TODOs and improve comments.

Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoHC tests: archive ODL logs (CSIT-1031) 78/12578/4
Marek Gradzki [Tue, 15 May 2018 08:42:58 +0000 (10:42 +0200)]
HC tests: archive ODL logs (CSIT-1031)

Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1082: Trending: Display date on the x-axis 76/12576/3
Tibor Frank [Tue, 15 May 2018 12:37:20 +0000 (14:37 +0200)]
CSIT-1082: Trending: Display date on the x-axis

Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC tests: archive JOB artifacts to logs.fd.io 73/12573/1
Marek Gradzki [Tue, 15 May 2018 08:31:19 +0000 (10:31 +0200)]
HC tests: archive JOB artifacts to logs.fd.io

Change-Id: I305c9fd0b5653cc749716a8e700fb4c75a9252a6
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC tests: disable NSH plugin (CSIT-994) 72/12572/1
Marek Gradzki [Tue, 15 May 2018 06:30:39 +0000 (08:30 +0200)]
HC tests: disable NSH plugin (CSIT-994)

This reverts https://gerrit.fd.io/r/#/c/12209/

Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 66/12566/1
Tibor Frank [Mon, 14 May 2018 12:35:46 +0000 (14:35 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1036 Expose option to install DKMS in container 52/12552/7
Peter Mikus [Sat, 12 May 2018 13:17:55 +0000 (15:17 +0200)]
CSIT-1036 Expose option to install DKMS in container

Expose DKMS installation as suite variable. This will allow to use DPDK
driver for future tests.

Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files and DPDK_STABLE_VER file 58/12558/2
Jan Gelety [Mon, 14 May 2018 07:01:16 +0000 (09:01 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~169-gab13462~b4246_amd64

- use new vpp ref build - centos7:
  18.07-rc0~169_gab13462~b4201.x86_64

- use new dpdk version:
  18.02.1-vpp1

Change-Id: Ie5da21bb685131fa5741ac394e5013c87b01c904
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 56/12556/1
Tibor Frank [Mon, 14 May 2018 07:00:52 +0000 (09:00 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 41/12541/2
Tibor Frank [Fri, 11 May 2018 13:14:13 +0000 (15:14 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1079 Add multiple mount dirs into container 40/12540/15
Peter Mikus [Fri, 11 May 2018 12:19:34 +0000 (14:19 +0200)]
CSIT-1079 Add multiple mount dirs into container

Pass the list of mount dirs into container LXC/Docker

Change-Id: Ie80062563955273791ab63e156bf0b369e5be649
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1076 Improve SSH connection handling 99/12499/7
Peter Mikus [Wed, 9 May 2018 11:40:12 +0000 (13:40 +0200)]
CSIT-1076 Improve SSH connection handling

Properly detect dropped connection via predicate is_active() to prevent
using dropped connection.

Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-992: Give MDR parameters official names 26/12526/2
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Give MDR parameters official names

Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdated testbed setup readme 72/12372/4
juraj.linkes [Thu, 3 May 2018 09:04:00 +0000 (11:04 +0200)]
Updated testbed setup readme

The section describing PXE server setup contained incorrect paths for
nginx server, which this patch fixes.

Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoCleanup DPDK framework setup 15/12515/6
Peter Mikus [Thu, 10 May 2018 06:38:06 +0000 (08:38 +0200)]
Cleanup DPDK framework setup

Moving installation of DPDK into KW instead of framework setup. This will
unify the framework setup and allow future optimizations.

Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC2VPP-253 - Update routing csit jobs 75/12075/14
Michal Cmarada [Wed, 9 May 2018 12:00:53 +0000 (14:00 +0200)]
HC2VPP-253 - Update routing csit jobs

this fixes test failures caused by HC2VPP routing
models bump (https://gerrit.fd.io/r/#/c/10954)

- updates tests for bgp routing
- updates tests for routing
- updates SLAAC test because of changes in rt-advertisements

Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoCSIT-1071 Add traffic evaluation criteria to MRR 66/12466/8
Peter Mikus [Mon, 7 May 2018 12:42:17 +0000 (14:42 +0200)]
CSIT-1071 Add traffic evaluation criteria to MRR

- Fail the testcase if there is no traffic pass.

Change-Id: I162187073aafa286793ce488fda9fd065bb55213
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Data sources 09/12509/2
Tibor Frank [Wed, 9 May 2018 18:58:56 +0000 (18:58 +0000)]
Report: Data sources

Change-Id: I6c81d52c0b16ae487ab54e89d9bebf1709ff6735
Signed-off-by: Tibor Frank <tifrank@cisco.com>