csit.git
5 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 00/13500/2
Jan Gelety [Tue, 17 Jul 2018 07:19:50 +0000 (09:19 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~517-g635ec3b~b4653

- use new vpp ref build - centos7:
  18.07-rc0~517_g635ec3b~b4569

- use new dpdk version:
  18.05-vpp2

Change-Id: I5fe34ea3603de136f8fe28fb8313533349257801
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoRefactor DPDK testcases to new structure 63/13463/10
Peter Mikus [Fri, 13 Jul 2018 11:44:29 +0000 (11:44 +0000)]
Refactor DPDK testcases to new structure

+ RXQ refactor

Change-Id: Ic03a2e208b9fe5d324a5ed75a603af4cff1854a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1094: Change menu style 26/13426/20
Tibor Frank [Wed, 11 Jul 2018 13:11:11 +0000 (15:11 +0200)]
CSIT-1094: Change menu style

Change-Id: Idff59bc73d3444700937fc473681760a947f0f41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1190: Update report configuration for 18.07 41/13441/2
Tibor Frank [Thu, 12 Jul 2018 06:29:33 +0000 (08:29 +0200)]
CSIT-1190: Update report configuration for 18.07

Change-Id: Ie7644fe3069ad37c15754a07e049f479903ca59a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd L2xc/L2bd/Ip4/Ip6 2-node tests for x710 81/13281/46
Peter Mikus [Thu, 28 Jun 2018 12:26:46 +0000 (12:26 +0000)]
Add L2xc/L2bd/Ip4/Ip6 2-node tests for x710

- CSIT-1161 Add 2-node L2XC tests
- CSIT-1160 Add 2-node L2BD tests
- CSIT-1157 Add 2-node IP4 tests
- CSIT-1153 Add 2-node IP6 KW
- CSIT-1158 Add 2-node IP6 tests

Change-Id: I7c8fed7018bb355c0de73f6a8bc3a8ec80366972
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: VTS suite 75/13475/1
Peter Mikus [Mon, 16 Jul 2018 04:51:45 +0000 (04:51 +0000)]
FIX: VTS suite

Change-Id: I1766ac51ac34b63feab80329c1ae2c62fc6d8496
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoRefactor perf test cases 01/13401/18
Peter Mikus [Tue, 10 Jul 2018 06:10:41 +0000 (06:10 +0000)]
Refactor perf test cases

- Refactor Performance TCs due to changes in Hyperthreading and RXQ allocations.
- Simplify the structure of suite to avoid large refactors in future.

Change-Id: Ifb1b9719391f26745f075a900bd9fb39b6cb809c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd stats segment heapsize to default config 47/13447/3
Peter Mikus [Thu, 12 Jul 2018 12:50:16 +0000 (12:50 +0000)]
Add stats segment heapsize to default config

- Scale tests (ip4, ip6) are failing due to low amount of stats segment
heapsize.

Change-Id: Id9b3e84d5a5c63014c17041c08c00ef6188afa5f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate skylake tesbed inventory 61/13461/1
Peter Mikus [Fri, 13 Jul 2018 07:33:16 +0000 (07:33 +0000)]
Update skylake tesbed  inventory

- Add missing topology files
- Add missing topologies to bootstrap
- Small fixes in ansible

Change-Id: I3b9ad60a0adfae9e93e5e700279f7ade81174471
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1168 Create bootstrap for 2-node topology 83/13383/7
Peter Mikus [Mon, 9 Jul 2018 08:16:05 +0000 (08:16 +0000)]
CSIT-1168 Create bootstrap for 2-node topology

Update existing bootstrap to recognize 2node/3node topologies

Change-Id: I2f81f9d69d824f7eea608413eac35a1598fad8c6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: PAL: input data processing 29/13429/2
Tibor Frank [Wed, 11 Jul 2018 14:48:49 +0000 (16:48 +0200)]
FIX: PAL: input data processing

Change-Id: I295ca0a991dea8104e9794d7013be908f5461ea2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate Ligato to latest dev branch 69/13069/17
Peter Mikus [Fri, 15 Jun 2018 08:22:27 +0000 (08:22 +0000)]
Update Ligato to latest dev branch

- Due to heavy modifications on vpp-agent docker images we need
to change build mechanics.

Change-Id: I26fb82ed1b2538335f7dc3dbb7f46ed2bb846583
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1186: Consume MLRsearch in agreed upon way 05/13405/4
Vratko Polak [Tue, 10 Jul 2018 12:07:02 +0000 (14:07 +0200)]
CSIT-1186: Consume MLRsearch in agreed upon way

+ Rename search to MLRsearch in resources/libraries/python/.
+ Make PyPI/MLRsearch/MLRsearch a symlink to the renamed directory.
+ TrafficGenerator.py to import from the renamed directory/module.
- No change to MLRsearch code.
- Version stays at 0.1.1 to point to the latest released code.

Change-Id: I4a38b0b7f8f083fbb1a93b25522560144b4ef556
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1178: Prepare for bursty MRR 71/12771/59
Vratko Polak [Tue, 10 Jul 2018 11:41:58 +0000 (13:41 +0200)]
CSIT-1178: Prepare for bursty MRR

+ All suites and tests still refer to MRR instead of BMRR (or FRMOBL).
+ API change: Traffic should pass with maximum rate
  first argument got a default value,
  thus it needs to be moved towards the end of argument list.
+ Consequently, the value for it has been deleted from suites.
+ Test message is now compatible only with BMRR parsing.
- Reporting of transmit rate is left as TODO.
+ Global test __init__ with new way of giving defaults to global variables.
+ The new keyword is put into robot_enhancements.robot resource.
+ Number of trials and trial duration are now configurable.
- Bootstrap scripts have no support for overriding the defaults yet.

Change-Id: I4b108cc9c256730e62c03fbacba0a1c314f8ae88
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1183: Process the new and the old TC names 03/13403/7
Tibor Frank [Tue, 10 Jul 2018 11:23:47 +0000 (13:23 +0200)]
CSIT-1183: Process the new and the old TC names

Change-Id: I7fcecd7e23494e8fb0e70e7af00408eed16733e4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd .gitattributes to make endlines automatic 04/13404/2
Vratko Polak [Tue, 10 Jul 2018 11:28:47 +0000 (13:28 +0200)]
Add .gitattributes to make endlines automatic

Change-Id: I9d58a5b0623c1b9d218e805fa619b324765f97a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1189: Add suite setup to source code documentation 09/13409/1
Tibor Frank [Tue, 10 Jul 2018 12:31:43 +0000 (14:31 +0200)]
CSIT-1189: Add suite setup to source code documentation

Change-Id: I0cc435ecacaeb5f9e8fd5c67f495166a1abd2e91
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoPAL: Treat the new and the old TC names 94/13394/2
Tibor Frank [Mon, 9 Jul 2018 14:00:28 +0000 (16:00 +0200)]
PAL: Treat the new and the old TC names

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: If5999de81b4e062d38ce44871f0c4d4fa794b55c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRemove THIS tag and use unix endlines 91/13391/2
Vratko Polak [Mon, 9 Jul 2018 13:14:36 +0000 (15:14 +0200)]
Remove THIS tag and use unix endlines

The THIS tag has sneaked in 10Ge2P1X520-Eth-L2Xcbase-Eth-1Memif-1Dcr-Mrr
but usually it is only to be used in draft testing.

Not sure about the way non-unix endlines crept in.
Is not git supposed to perform endline conversions on text files?
Or are .robot, .rst, .yaml and .vat not recognized as text?

Change-Id: Ia78cf942c05c3029c340a8639782786f37e57469
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1142 2-node topology - keywords DPDK 86/13386/8
Peter Mikus [Mon, 9 Jul 2018 09:55:00 +0000 (09:55 +0000)]
CSIT-1142 2-node topology - keywords DPDK

Change-Id: Ia2676a7b846bd574aa86703fce6b0e3218f98776
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: use correct match_n_vectors value in IPx iACL TC03 93/13393/1
Jan Gelety [Mon, 9 Jul 2018 13:48:57 +0000 (15:48 +0200)]
FIX: use correct match_n_vectors value in IPx iACL TC03

Change-Id: I2e454a2410ffda2673745e6415666a0f96291491
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: Implement changes required by Plot.ly 3.0.0 85/13385/6
Tibor Frank [Mon, 9 Jul 2018 09:51:13 +0000 (11:51 +0200)]
FIX: Implement changes required by Plot.ly 3.0.0

 - Scatter.xaxix.autotick
 - Scatter.yaxis.range[]

Change-Id: I171e0c4a796f713985b69fae23bfb768590274b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1142 Change thread perf test TAGs 77/13377/9
Peter Mikus [Fri, 6 Jul 2018 19:06:41 +0000 (19:06 +0000)]
CSIT-1142 Change thread perf test TAGs

Due to automatization of SMT detection this change is suppose to
remove static thread/core tags in favor of dynamic one. Leaving the
static tags for number of physical cores to be able to select TCs.

Change-Id: I7f99f605821f363e45c333f46d1dea786693521b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1142 2-node topology - keywords 68/13368/14
Peter Mikus [Fri, 6 Jul 2018 06:39:51 +0000 (06:39 +0000)]
CSIT-1142 2-node topology - keywords

- Clean up of 2-node setup KWs

Change-Id: I59fc901fb57544eceb6a041b56b515cda8babf85
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 80/13380/1
Jan Gelety [Mon, 9 Jul 2018 06:34:41 +0000 (08:34 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~471-g65784c1~b4600

- use new vpp ref build - centos7:
  18.07-rc0~471_g65784c1~b4520

- use new dpdk version:
  18.05-vpp1

Change-Id: Ica5f07d07b2e4893fb2ba67573a2aec5d23e1b2d
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdd Skylake optimization to ansible 67/13367/2
Peter Mikus [Fri, 6 Jul 2018 05:18:01 +0000 (05:18 +0000)]
Add Skylake optimization to ansible

- Add kernel params
- Add TurboBoost managing

Change-Id: I9d9561290f8f6780ff41f3a418a1f335d935d843
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoVTS VXLAN vhost-user with single DUT, TG sends VXLAN 70/11070/15
Peter Ginchev [Wed, 11 Apr 2018 07:27:45 +0000 (10:27 +0300)]
VTS VXLAN vhost-user with single DUT, TG sends VXLAN

Change-Id: I63539af2cdbdbd02a67068e48d0fdf2743da3b1e
Signed-off-by: Peter Ginchev <pginchev@cisco.com>
5 years agoCSIT-1046 Make uio driver configurable from topofiles 26/13326/3
Peter Mikus [Tue, 3 Jul 2018 05:01:46 +0000 (05:01 +0000)]
CSIT-1046 Make uio driver configurable from topofiles

Currently we are configuring uio_driver from global variable.
This may not be suitable for various topologies where we need
different driver per TB. This patch is suppose to put uio_driver
into topology files.

Change-Id: I56af0697e8b2359ccb126151217976408720c1ba
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 15/13315/2
Jan Gelety [Mon, 2 Jul 2018 07:56:58 +0000 (09:56 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~449_gef8ead5~b4498

- use new vpp ref build - centos7:
  18.07-rc0~449-gef8ead5~b4575

- use new dpdk version:
  18.02.2-vpp1

Change-Id: I6b708288dbad895fcfa454b8fda62446074b32a4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCompatibility fixes with Ubuntu 18.04 09/13309/4
Peter Mikus [Sun, 1 Jul 2018 06:13:54 +0000 (06:13 +0000)]
Compatibility fixes with Ubuntu 18.04

Currently we are using ip:port socket to for VPP to listen for incoming
connections. There is only one place in code this socket is used for
detection if VPP is responding after restart. This patch is supposed to
change ip:port to sock:file which is default preffered way in VPP. This
way we can start using vppctl. netcat on the other side with ip:port
remains hanged in console for infinite time not returning back.

There is also need to check whether uio_module is loaded and eventually
load it. As uio_pci_generic is not working there, we will fallback to
main igb_uio (uio_pci_generic being only lightweight subset of igb_uio).

This patch also add additional verbose output to console during setup to
better understand if failure happens during copy/extract/setup.

Change-Id: I0b8a3b76dce3316496a3ad928f58718b6e73057d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348) 06/13306/1
Marek Gradzki [Fri, 29 Jun 2018 19:26:22 +0000 (21:26 +0200)]
HC Tests: use vpp-fib-management module in dhcp tests (HC2VPP-348)

Addaps HC DHCP tests to https://gerrit.fd.io/r/#/c/13299/

Change-Id: I874da5ee76fcfdb5039c1b3ad33aec4af80396d0
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoAdd vfio-pci support on all TB 98/13298/2
Peter Mikus [Fri, 29 Jun 2018 12:16:06 +0000 (12:16 +0000)]
Add vfio-pci support on all TB

- Add auto load of vfio-pci
- Add iommu support

Change-Id: I13611fab9db2813eeab7f90c8f961594349e561e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1124: Support multi-sample tests 02/13202/44
Tibor Frank [Mon, 25 Jun 2018 10:48:43 +0000 (12:48 +0200)]
CSIT-1124: Support multi-sample tests

 + Store parsed MRR results as AvgStdevMetadata
 + Modify tables and plots to use AvgStdevMetadata

Change-Id: I29bb1e492a664544e63a180055f66bb0eecfb957
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoSetupFramework to detect failures, part II 66/13266/3
Peter Mikus [Thu, 28 Jun 2018 07:29:06 +0000 (07:29 +0000)]
SetupFramework to detect failures, part II

- This patch is enforcing evaluation and aligning all __init__.robot
files to use the same logic.

Change-Id: I9e2bf5e904bb6d22f4e6a153c951c3b3c233e2fb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoJumpavg: Post 0.1.3 release edits 78/13278/1
Vratko Polak [Thu, 28 Jun 2018 12:14:38 +0000 (14:14 +0200)]
Jumpavg: Post 0.1.3 release edits

+ PyPI/jumpavg version bumped to 0.1.4.
+ presentation requirements bumped to 0.1.3.
+ Added stub for change log in readme.

Change-Id: I21a606ed7d9aa2b9cc761ed20f94bda41963a1a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoFix jumpavg: No negative variance from rounding 76/13276/2
Vratko Polak [Thu, 28 Jun 2018 11:07:14 +0000 (13:07 +0200)]
Fix jumpavg: No negative variance from rounding

The algorithm for computing stdev has been changed
to a more stable one, based on Welford's algorithm.

Change-Id: I51e02d9c5c26cda0d4e998381d5011aa793e6483
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd New Skylake topology files 31/13231/8
Peter Mikus [Wed, 27 Jun 2018 05:35:25 +0000 (05:35 +0000)]
Add New Skylake topology files

Change-Id: I6109729ee303806f69bba365c93b4de67b9a8c32
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: SetupFramework to detect failures 18/13218/7
Peter Mikus [Tue, 26 Jun 2018 08:45:06 +0000 (08:45 +0000)]
FIX: SetupFramework to detect failures

- Fix behavior of setup framework to properly detect and raise
exception in case of any issue occurs during framework setup on any node
- General code cleanup

Change-Id: Id4cf36e221817600164b25d5551582838b0f0d5e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoSmall update to PXE installation README 16/13216/1
Peter Mikus [Tue, 26 Jun 2018 05:16:49 +0000 (05:16 +0000)]
Small update to PXE installation README

Change-Id: I1766e3cd81cfe4ed049ed3e7034fff1e367396d4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate PXE info about new Skylake machines 04/13204/1
Peter Mikus [Mon, 25 Jun 2018 12:07:17 +0000 (12:07 +0000)]
Update PXE info about new Skylake machines

Change-Id: Ide828efb0e539ae7bf9c5cfd128f35d8117f3643
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 00/13200/2
Jan Gelety [Mon, 25 Jun 2018 07:42:19 +0000 (09:42 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~394-ge0d2bd6~b4508

- use new vpp ref build - centos7:
  18.07-rc0~394_ge0d2bd6~b4435

Change-Id: I3b1a749cf4192321af9ec1e9d297b938092d4135
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: use correct path to vpp build packages in weekly bootstrap 01/13201/2
Jan Gelety [Mon, 25 Jun 2018 08:04:31 +0000 (10:04 +0200)]
FIX: use correct path to vpp build packages in weekly bootstrap

Change-Id: I5a92499cc7f1e475614126fcb6044d48615673ab
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1043: Execute pci rescan only if needed 61/12961/10
juraj.linkes [Fri, 8 Jun 2018 08:47:27 +0000 (10:47 +0200)]
CSIT-1043: Execute pci rescan only if needed

Pci rescan is a rather invasive process, which is why it should be
executed only if needed. This patch moves the pci rescan after
pci device driver discovery, rescanning the devices for further attemps
at driver discovery.

Change-Id: I29c939b44c3f67371416a99c711e057f711ba9b4
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoFix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-func 72/13172/2
Michal Cmarada [Thu, 21 Jun 2018 08:17:40 +0000 (10:17 +0200)]
Fix TC02 test case in mgmt-cfg-int-subint-apihc-apivat-func

Add wait for interface to be up, because it
takes some time while the interface state changes.

Change-Id: I895dea1017ac0ffd099e80d9edca0f1d127657dd
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoHC2VPP-331: Fix Honeycomb fails to assign VRF to interface 20/13120/4
Michal Cmarada [Thu, 21 Jun 2018 07:53:08 +0000 (09:53 +0200)]
HC2VPP-331: Fix Honeycomb fails to assign VRF to interface

- add configuration for FIB table management to test suite
- fix routing test suite HC2VPP-331 bugs
- fix intip4-intip6 test suite HC2VPP-331 bugs

Change-Id: I0b1e9ed787d9fb68e76a6d61c1eea2519a36a6c4
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoCSIT-1136: Trending: Redirect "new" to the index.html 70/13170/1
Tibor Frank [Thu, 21 Jun 2018 07:59:54 +0000 (09:59 +0200)]
CSIT-1136: Trending: Redirect "new" to the index.html

 - remove the code which generated redirection

Change-Id: Ia12ea1129724d92a6ac6e88782e562c23722ae48
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1136: Trending: Redirect "new" to the index.html 65/13165/2
Tibor Frank [Thu, 21 Jun 2018 05:26:27 +0000 (07:26 +0200)]
CSIT-1136: Trending: Redirect "new" to the index.html

Change-Id: I2480a59fb34af70d78bc7404cd380c4b4d3ea483
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: PAL - list of failed tests 56/13156/1
Tibor Frank [Wed, 20 Jun 2018 13:21:47 +0000 (15:21 +0200)]
FIX: PAL - list of failed tests

Change-Id: I03341283270e53df6bcb08b32f1787f61ebb601c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Replace old trending with the new one 45/13145/1
Vratko Polak [Wed, 20 Jun 2018 10:56:41 +0000 (12:56 +0200)]
CSIT-1110: Replace old trending with the new one

+ Remove /new/ folders in presentation and docs.

Change-Id: I870002ba8509189196e778aa1292b93e83a3ec17
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoRevert "CSIT-986: Use MLRsearch from pip" 36/13136/2
Peter Mikus [Wed, 20 Jun 2018 06:09:32 +0000 (06:09 +0000)]
Revert "CSIT-986: Use MLRsearch from pip"

This reverts commit 0c2c57d9965ab1db0d5404ad103871ac250339cb.

Reason for revert: unless you will fix this broken patch we have to revert this as it breaks several thing in the csit core ci/cd.

1) all tb are pypi offline this means no new pypi is automatically dowloaded. Everytime you change your version you have to update every tb. As this is not automated this will never work and put extreme overhead

2) this code is not pylint checked and not verified by any existing job breaking any kind of verificition mechanics in csit

3)there is no automation in terms of creating pypi (no job) this creates chicken egg problem that you cannot verify change unless new version is installed

Next time please think or consult with more seniored csit core developer
Unless above will be fixed i will revert on monday as now it breaks all jobs. I will set hard verification to framework setup (exception) so this will prevent next time merge.
Possible solution:
1)Move the directory back to resources and reference from csit directly not via pypi, leave the setup crap in dir and let users to create package on their own

Change-Id: Id530a9f19f668e45f73ffc9e7371bb453b59fd1b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER and DPDK_STABLE_VER files 27/13127/3
Jan Gelety [Tue, 19 Jun 2018 14:30:14 +0000 (16:30 +0200)]
Update of VPP_STABLE_VER and DPDK_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~358-ga5ee900~b4457

- use new vpp ref build - centos7:
  18.07-rc0~358_ga5ee900~b4395

- use new dpdk version:
  18.02.1-vpp2

Change-Id: Idc72e3a01dbb1b479a4a9b6404c4b01d5a7c4627
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1110: Improve new detection methodology doc 11/13011/9
Vratko Polak [Thu, 14 Jun 2018 12:03:44 +0000 (14:03 +0200)]
CSIT-1110: Improve new detection methodology doc

Change-Id: I068fd4e9418f232ee1e1f13994e9c5c431478ec8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUse pkg download script in bootstrap files 28/11928/39
Peter Mikus [Thu, 19 Apr 2018 12:52:50 +0000 (14:52 +0200)]
Use pkg download script in bootstrap files

Download specific version of VPP/DKMS via download script.

Change-Id: I6585790224d746a9edea7fa6624e810f389218e6
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1133: Cosmetic improvements in trending plots 17/13117/3
Tibor Frank [Tue, 19 Jun 2018 08:46:42 +0000 (10:46 +0200)]
CSIT-1133: Cosmetic improvements in trending plots

 - Remove "outlier" from the colorbar
 - Remove anomalies from the legend

Change-Id: Idd3255d912c48c80347a773a6b19307e90a53926
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-986: Use MLRsearch from pip 97/13097/2
Vratko Polak [Mon, 18 Jun 2018 14:00:06 +0000 (16:00 +0200)]
CSIT-986: Use MLRsearch from pip

+ Delete resources/libraries/python/search/.
+ Add MLRsearch==0.1.1 to requirements.txt.
+ Bump PyPI/MLRsearch version to 0.1.2.

Change-Id: I1f86d75ac8eb90ee3946dbac8c56280f39302f4d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1126: Detection and reporting of failed MRR tests 28/13028/20
Tibor Frank [Wed, 13 Jun 2018 13:19:18 +0000 (15:19 +0200)]
CSIT-1126: Detection and reporting of failed MRR tests

Change-Id: Iafdd12a573b58ab3ba9c69699cd97c5a4e598601
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-986: Implement proposed MDR improvements 61/12761/10
Vratko Polak [Mon, 28 May 2018 09:53:45 +0000 (11:53 +0200)]
CSIT-986: Implement proposed MDR improvements

+ Use first intermediate with goal in initial phase.
+ Measure above MRR if that got zero loss.
+ Always prioritizes NDR in internal search.
+ Rename classes.
+ Copy code for standalone PyPI publishing.
- Original files will be deleted after publish.

Change-Id: I5169d602d1e5e35a1894645cd52e70d791871608
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Update code after jumpavg 0.1.2 release 91/13091/1
Tibor Frank [Mon, 18 Jun 2018 06:10:54 +0000 (08:10 +0200)]
CSIT-1110: Update code after jumpavg 0.1.2 release

+ Use the released version in PAL.
+ Bump the jumpavg source to 0.1.3 for next release.
+ Add PyPI/owners.txt to track python package owner group.

Change-Id: I29284a258b24f9991379719313f30cce0349c2bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate Ansible with new Skylake machines 86/13086/2
Peter Mikus [Fri, 15 Jun 2018 12:29:07 +0000 (12:29 +0000)]
Update Ansible with new Skylake machines

Change-Id: Ia5d0b680deaf7da60696bf2d0260cf7fbea78322
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1085 eth-l2xcbase-eth-1memif-1dcr 14/12614/21
Peter Mikus [Thu, 17 May 2018 07:51:35 +0000 (09:51 +0200)]
CSIT-1085 eth-l2xcbase-eth-1memif-1dcr

Test case definitions

Change-Id: I03736ef003d3839859dc450745323362b21aa75e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoRevert "CSIT-1110: Update code after jumpavg 0.1.2 release" 84/13084/1
Tibor Frank [Fri, 15 Jun 2018 12:02:22 +0000 (12:02 +0000)]
Revert "CSIT-1110: Update code after jumpavg 0.1.2 release"

This reverts commit f7c46f067a8fb594d2460aaadbe1ca9282b657a8.

Change-Id: I409335daac8f9e02bea4e12f2141ab9ceb338964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Update code after jumpavg 0.1.2 release 76/13076/1
Vratko Polak [Fri, 15 Jun 2018 11:19:57 +0000 (13:19 +0200)]
CSIT-1110: Update code after jumpavg 0.1.2 release

+ Use the released version in PAL.
+ Bump the jumpavg source to 0.1.3 for next release.
+ Add PyPI/owners.txt to track python package owner group.

Change-Id: I0146efcc7c0b7eefc068464739afa605eda2b2d8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Use jumpavg library from pip 38/13038/5
Vratko Polak [Thu, 14 Jun 2018 12:04:03 +0000 (14:04 +0200)]
CSIT-1110: Use jumpavg library from pip

+ Move the jumpavg library code to separate directory.
- Bump to 0.1.2 has to be done later.

Change-Id: I9722ede48f00e99eeb68ca3f91e0bdeee2937973
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Add files for PyPI migration 36/13036/3
Vratko Polak [Wed, 13 Jun 2018 15:18:05 +0000 (17:18 +0200)]
CSIT-1110: Add files for PyPI migration

Change-Id: I3414d4391f339ee67066491382b59239a81db241
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Prepare for migrating the new detection 35/13035/3
Vratko Polak [Wed, 13 Jun 2018 11:04:01 +0000 (13:04 +0200)]
CSIT-1110: Prepare for migrating the new detection

+ Do not declare BitCountingClassifier.classify() as class method.
+ Make BitCountingGroupList subclass of list.
+ Inherit from abstract classes whenever possible.
+ Drop unneeded imports.
+ Add module docstrings and class docstrings anywhere.
+ Add TODOs hinting at possible improvements.

Change-Id: Iccfff5c0e7be0607d6cfa74314083fcfe5a4d7d9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-PERF: New trigger design 25/13025/12
Peter Mikus [Wed, 13 Jun 2018 12:09:47 +0000 (12:09 +0000)]
CSIT-PERF: New trigger design

- CSIT-1128
- This patch is implementing processing of TAGS specified
as part of commit message

Change-Id: Iad0923d22fae369dfe923a917e1c0d47d5cbf656
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TAG processing 33/13033/1
Peter Mikus [Wed, 13 Jun 2018 14:34:06 +0000 (14:34 +0000)]
FIX: TAG processing

Change-Id: I08815de519532e8a20873f8b172d3f42ccfa33fb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TAG processing 26/13026/4
Peter Mikus [Wed, 13 Jun 2018 12:25:51 +0000 (12:25 +0000)]
FIX: TAG processing

- Improve TAG post processing

Change-Id: I5a36f5874ea747cbcae2562fc58c9f5abe9bac02
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-942: RCA - Option 1: Analysing Archived VPP Results 00/11400/5
Tibor Frank [Tue, 27 Mar 2018 12:37:42 +0000 (14:37 +0200)]
CSIT-942: RCA - Option 1: Analysing Archived VPP Results

 - CSIT-953: LLD

Change-Id: I0baefd8495f6ae8dc6f95f1cf29f5ccb8053d58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Fix dashboard anomaly count range 19/13019/1
Vratko Polak [Wed, 13 Jun 2018 08:23:06 +0000 (10:23 +0200)]
CSIT-1110: Fix dashboard anomaly count range

+ Dashboard tables should now report anomalies from last week only.
+ Changed handling of Nan to report regression.

Change-Id: I624b0bc84a93702a31fc79fd670bd645b963f1f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agolink for start-testcase-DMM 88/12988/3
sharath [Mon, 11 Jun 2018 12:21:49 +0000 (17:51 +0530)]
link for start-testcase-DMM

Change-Id: I2687f6408483cd88a2c820d6da03df511e087ba4
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
5 years agoCSIT-1110 PAL: Fix warnings by moving new docs 06/13006/1
Vratko Polak [Tue, 12 Jun 2018 12:55:42 +0000 (14:55 +0200)]
CSIT-1110 PAL: Fix warnings by moving new docs

Change-Id: Ie6483e9245872bc6991ed1f3c7aab60131e1eeb1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110 PAL: Use group averages for term changes 92/12992/2
Vratko Polak [Mon, 11 Jun 2018 16:45:20 +0000 (18:45 +0200)]
CSIT-1110 PAL: Use group averages for term changes

+ Apply only to trending dashboard tables.
+ Remove outlier column.
- Dashboard description not updated yet.

Change-Id: I30e5267c4621564cd4d3ae8bd969d2ef72531d81
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoMask out LBOND_DPDK tags from per patch verification 98/12998/1
Peter Mikus [Tue, 12 Jun 2018 08:54:08 +0000 (08:54 +0000)]
Mask out LBOND_DPDK tags from per patch verification

Change-Id: I47a5261e9a9b590a408bda093a9310dc38c85873
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1110: Cherry-pick edits into new detection 86/12986/2
Vratko Polak [Mon, 11 Jun 2018 12:47:50 +0000 (14:47 +0200)]
CSIT-1110: Cherry-pick edits into new detection

+ Edit methodology documentation.

Change-Id: I441e17862aba4a8572c7c532ed8995790111b4d4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1110: Integrate anomaly detection into PAL 55/12855/8
Vratko Polak [Fri, 8 Jun 2018 16:07:35 +0000 (18:07 +0200)]
CSIT-1110: Integrate anomaly detection into PAL

+ Keep the original detection,
+ add the new one as subdirectory
  (both in source and in rendered tree).
- The new detection is not rebased over "Add dpdk mrr tests to trending".

New detection features:
+ Do not remove (nor detect) outliers.
+ Trend line shows the constant average within a group.
+ Anomaly circles are placed at the changed average.
+ Small bias against too similar averages.
+ Should be ready for moving the detection library out to pip.

Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Add link to testbed HW specification. 81/12981/2
Tibor Frank [Mon, 11 Jun 2018 06:05:31 +0000 (08:05 +0200)]
Trending: Add link to testbed HW specification.

Change-Id: Ib000f2146bf0612b88c605413108b22fa4a99210
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1116: Add dpdk mrr tests to trending 86/12886/25
Tibor Frank [Tue, 5 Jun 2018 10:25:32 +0000 (12:25 +0200)]
CSIT-1116: Add dpdk mrr tests to trending

 - Add static content
 - Add models to specification
 - Add plots
 - Add dpdk tests to dashboard
 - Add dpdk to csv and pretty ASCII tables
 - Get DPDK version from output.xml

Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1114 Add DPDK download to bootstrap 60/12960/8
Peter Mikus [Fri, 8 Jun 2018 05:59:48 +0000 (05:59 +0000)]
CSIT-1114 Add DPDK download to bootstrap

- Add downloading artifacts to bootstrap to be able to use latest dpdk version

Change-Id: I5f07e8207780b81ad85b6053db99639c47448409
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1081 Container VPP configuration refactor 64/12564/18
Peter Mikus [Mon, 14 May 2018 11:22:42 +0000 (13:22 +0200)]
CSIT-1081 Container VPP configuration refactor

Adopt code for various topology configurations.

Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd DPDK IMIX tests to trending 57/12957/1
Tibor Frank [Fri, 8 Jun 2018 04:32:36 +0000 (06:32 +0200)]
Add DPDK IMIX tests to trending

Change-Id: Ibacb08a72b939346c90489282b10ebc001446f4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1122: Add link bonding tests for x710 to the Trending 41/12941/1
Tibor Frank [Thu, 7 Jun 2018 12:15:26 +0000 (14:15 +0200)]
CSIT-1122: Add link bonding tests for x710 to the Trending

Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1121: Add "Get DPDK version" KW to DPDK tests 29/12929/5
Tibor Frank [Thu, 7 Jun 2018 08:03:17 +0000 (10:03 +0200)]
CSIT-1121: Add "Get DPDK version" KW to DPDK tests

Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 85/12885/2
Jan Gelety [Tue, 5 Jun 2018 07:59:37 +0000 (09:59 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~278-gb2371c2~b4361_amd64

- use new vpp ref build - centos7:
  18.07-rc0~278_gb2371c2~b4311.x86_64

Change-Id: Idbb5d2c01839d4bca5cfd4ee9b26788bd15d3905
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHC Tests: reenable NSH plugin (CSIT-994) 48/12848/3
Marek Gradzki [Fri, 1 Jun 2018 10:58:15 +0000 (12:58 +0200)]
HC Tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/12572/

Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1115: Add dpdk mrr tests 84/12884/5
Tibor Frank [Tue, 5 Jun 2018 07:48:24 +0000 (09:48 +0200)]
CSIT-1115: Add dpdk mrr tests

Change-Id: Ib9d060f7e0d476b79debc750409da5277478e5b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: fix 90/12890/1
Tibor Frank [Tue, 5 Jun 2018 11:32:47 +0000 (13:32 +0200)]
Trending: fix

Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix 88/12888/1
Tibor Frank [Tue, 5 Jun 2018 11:10:28 +0000 (13:10 +0200)]
Trending: Fix

Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Print NameError to reduce confusion 49/12849/3
Vratko Polak [Mon, 4 Jun 2018 13:33:10 +0000 (15:33 +0200)]
CSIT-1110: Print NameError to reduce confusion

See https://gerrit.fd.io/r/12724
for an example mistake which also can cause NameError.

Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1112: Add link bonding tests to the Trending 40/12840/3
Tibor Frank [Fri, 1 Jun 2018 09:17:22 +0000 (11:17 +0200)]
CSIT-1112: Add link bonding tests to the Trending

Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd DPDK MRR weekly into bootstrap 70/12870/2
Peter Mikus [Mon, 4 Jun 2018 06:11:46 +0000 (06:11 +0000)]
Add DPDK MRR weekly into bootstrap

Change-Id: Ia8c62035afe4178f1967cc1683afed7476186f7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoVPP link bonding - lacp mode 23/12623/24
Jan Gelety [Thu, 17 May 2018 12:31:43 +0000 (14:31 +0200)]
VPP link bonding - lacp mode

CSIT-1072
CSIT-1083
CSIT-1084

Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHC Tests: disable failing ACL ODL tests (HC2VPP-337) 23/12823/2
Marek Gradzki [Thu, 31 May 2018 06:38:25 +0000 (08:38 +0200)]
HC Tests: disable failing ACL ODL tests (HC2VPP-337)

Change-Id: I1fa3e3876bcc0b4f5e9908cb4f6920d49eb6dd45
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1055: Pkg download script to use package system not curl 84/12484/7
Peter Mikus [Wed, 9 May 2018 06:50:10 +0000 (08:50 +0200)]
CSIT-1055: Pkg download script to use package system not curl

- Rework VPP package download script

Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325) 11/12811/2
Marek Gradzki [Wed, 30 May 2018 15:07:29 +0000 (17:07 +0200)]
HC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325)

Adapts HC tests to
https://gerrit.fd.io/r/#/c/12810/

Change-Id: I6783b2db061c4cde0942dbb8583e7af8687c54d3
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoAdd s17-t33-tg1 into ansible/pxe 24/12824/2
Peter Mikus [Thu, 31 May 2018 06:39:45 +0000 (06:39 +0000)]
Add s17-t33-tg1 into ansible/pxe

Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoDPDK link bonding: xor mode 37/12537/33
Jan Gelety [Fri, 11 May 2018 08:36:41 +0000 (10:36 +0200)]
DPDK link bonding: xor mode

CSIT-1073
CSIT-1074
CSIT-1077

Change-Id: I248e079021c30988210fd792b32d5afdca71aadb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1068 Update testbed-setup for new server onboarding 22/12622/10
Peter Mikus [Thu, 17 May 2018 12:31:50 +0000 (14:31 +0200)]
CSIT-1068 Update testbed-setup for new server onboarding

Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1070 Update Ansible structure 60/12660/10
Peter Mikus [Sat, 19 May 2018 13:15:29 +0000 (15:15 +0200)]
CSIT-1070 Update Ansible structure

Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 88/12788/1
Jan Gelety [Tue, 29 May 2018 13:52:45 +0000 (15:52 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~252-g229c1aa~b4334_amd64

- use new vpp ref build - centos7:
  18.07-rc0~252_g229c1aa~b4285.x86_64

Change-Id: I596520740ed93e31617ee382108bcba269771423
Signed-off-by: Jan Gelety <jgelety@cisco.com>