csit.git
5 years agoCSIT-1110: Integrate anomaly detection into PAL 55/12855/8
Vratko Polak [Fri, 8 Jun 2018 16:07:35 +0000 (18:07 +0200)]
CSIT-1110: Integrate anomaly detection into PAL

+ Keep the original detection,
+ add the new one as subdirectory
  (both in source and in rendered tree).
- The new detection is not rebased over "Add dpdk mrr tests to trending".

New detection features:
+ Do not remove (nor detect) outliers.
+ Trend line shows the constant average within a group.
+ Anomaly circles are placed at the changed average.
+ Small bias against too similar averages.
+ Should be ready for moving the detection library out to pip.

Change-Id: I7ab1a92b79eeeed53ba65a071b1305e927816a89
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Add link to testbed HW specification. 81/12981/2
Tibor Frank [Mon, 11 Jun 2018 06:05:31 +0000 (08:05 +0200)]
Trending: Add link to testbed HW specification.

Change-Id: Ib000f2146bf0612b88c605413108b22fa4a99210
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1116: Add dpdk mrr tests to trending 86/12886/25
Tibor Frank [Tue, 5 Jun 2018 10:25:32 +0000 (12:25 +0200)]
CSIT-1116: Add dpdk mrr tests to trending

 - Add static content
 - Add models to specification
 - Add plots
 - Add dpdk tests to dashboard
 - Add dpdk to csv and pretty ASCII tables
 - Get DPDK version from output.xml

Change-Id: I2d9a911d882c205f82432125b601b125807f0ca0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1114 Add DPDK download to bootstrap 60/12960/8
Peter Mikus [Fri, 8 Jun 2018 05:59:48 +0000 (05:59 +0000)]
CSIT-1114 Add DPDK download to bootstrap

- Add downloading artifacts to bootstrap to be able to use latest dpdk version

Change-Id: I5f07e8207780b81ad85b6053db99639c47448409
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1081 Container VPP configuration refactor 64/12564/18
Peter Mikus [Mon, 14 May 2018 11:22:42 +0000 (13:22 +0200)]
CSIT-1081 Container VPP configuration refactor

Adopt code for various topology configurations.

Change-Id: Iaf9d7995ab8cd06da0c56c5e5664d57d19e74d7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd DPDK IMIX tests to trending 57/12957/1
Tibor Frank [Fri, 8 Jun 2018 04:32:36 +0000 (06:32 +0200)]
Add DPDK IMIX tests to trending

Change-Id: Ibacb08a72b939346c90489282b10ebc001446f4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1122: Add link bonding tests for x710 to the Trending 41/12941/1
Tibor Frank [Thu, 7 Jun 2018 12:15:26 +0000 (14:15 +0200)]
CSIT-1122: Add link bonding tests for x710 to the Trending

Change-Id: I199195bd771fcf9d363a91037cf98254b2d0b923
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1121: Add "Get DPDK version" KW to DPDK tests 29/12929/5
Tibor Frank [Thu, 7 Jun 2018 08:03:17 +0000 (10:03 +0200)]
CSIT-1121: Add "Get DPDK version" KW to DPDK tests

Change-Id: I6152b3b7d4895a376914166d03ee9ca15ea9eb32
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 85/12885/2
Jan Gelety [Tue, 5 Jun 2018 07:59:37 +0000 (09:59 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~278-gb2371c2~b4361_amd64

- use new vpp ref build - centos7:
  18.07-rc0~278_gb2371c2~b4311.x86_64

Change-Id: Idbb5d2c01839d4bca5cfd4ee9b26788bd15d3905
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHC Tests: reenable NSH plugin (CSIT-994) 48/12848/3
Marek Gradzki [Fri, 1 Jun 2018 10:58:15 +0000 (12:58 +0200)]
HC Tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/12572/

Change-Id: Ic55016e3c257a81440332a212e4c0d83e1990668
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1115: Add dpdk mrr tests 84/12884/5
Tibor Frank [Tue, 5 Jun 2018 07:48:24 +0000 (09:48 +0200)]
CSIT-1115: Add dpdk mrr tests

Change-Id: Ib9d060f7e0d476b79debc750409da5277478e5b4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: fix 90/12890/1
Tibor Frank [Tue, 5 Jun 2018 11:32:47 +0000 (13:32 +0200)]
Trending: fix

Change-Id: Ia039b1bc15d52ab8e3bddfd2d09ea5cf4190c67c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: Fix 88/12888/1
Tibor Frank [Tue, 5 Jun 2018 11:10:28 +0000 (13:10 +0200)]
Trending: Fix

Change-Id: Ib9f8d20cb500bb6f485a5fa6211ce1fb00b260a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1110: Print NameError to reduce confusion 49/12849/3
Vratko Polak [Mon, 4 Jun 2018 13:33:10 +0000 (15:33 +0200)]
CSIT-1110: Print NameError to reduce confusion

See https://gerrit.fd.io/r/12724
for an example mistake which also can cause NameError.

Change-Id: I65c74744c027800a95014f3be48d0f522a10ce2b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1112: Add link bonding tests to the Trending 40/12840/3
Tibor Frank [Fri, 1 Jun 2018 09:17:22 +0000 (11:17 +0200)]
CSIT-1112: Add link bonding tests to the Trending

Change-Id: I3130904423b0e5b24e20d0c74d1b238d2de16f46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd DPDK MRR weekly into bootstrap 70/12870/2
Peter Mikus [Mon, 4 Jun 2018 06:11:46 +0000 (06:11 +0000)]
Add DPDK MRR weekly into bootstrap

Change-Id: Ia8c62035afe4178f1967cc1683afed7476186f7c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoVPP link bonding - lacp mode 23/12623/24
Jan Gelety [Thu, 17 May 2018 12:31:43 +0000 (14:31 +0200)]
VPP link bonding - lacp mode

CSIT-1072
CSIT-1083
CSIT-1084

Change-Id: Icaf0e09af633d301306a84251f47822e95b411a2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHC Tests: disable failing ACL ODL tests (HC2VPP-337) 23/12823/2
Marek Gradzki [Thu, 31 May 2018 06:38:25 +0000 (08:38 +0200)]
HC Tests: disable failing ACL ODL tests (HC2VPP-337)

Change-Id: I1fa3e3876bcc0b4f5e9908cb4f6920d49eb6dd45
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1055: Pkg download script to use package system not curl 84/12484/7
Peter Mikus [Wed, 9 May 2018 06:50:10 +0000 (08:50 +0200)]
CSIT-1055: Pkg download script to use package system not curl

- Rework VPP package download script

Change-Id: I51aca96fc3b834d8e17cf349a5a7b9d7105f2184
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325) 11/12811/2
Marek Gradzki [Wed, 30 May 2018 15:07:29 +0000 (17:07 +0200)]
HC Tests: use ip-prefix in NAT mapping entries (HC2VPP-325)

Adapts HC tests to
https://gerrit.fd.io/r/#/c/12810/

Change-Id: I6783b2db061c4cde0942dbb8583e7af8687c54d3
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoAdd s17-t33-tg1 into ansible/pxe 24/12824/2
Peter Mikus [Thu, 31 May 2018 06:39:45 +0000 (06:39 +0000)]
Add s17-t33-tg1 into ansible/pxe

Change-Id: I1e44a17391b19aa09042d02e6f072a7ee3738bb8
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoDPDK link bonding: xor mode 37/12537/33
Jan Gelety [Fri, 11 May 2018 08:36:41 +0000 (10:36 +0200)]
DPDK link bonding: xor mode

CSIT-1073
CSIT-1074
CSIT-1077

Change-Id: I248e079021c30988210fd792b32d5afdca71aadb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1068 Update testbed-setup for new server onboarding 22/12622/10
Peter Mikus [Thu, 17 May 2018 12:31:50 +0000 (14:31 +0200)]
CSIT-1068 Update testbed-setup for new server onboarding

Change-Id: I5e1588b432ebd5655a5451f8f19903f28d1fee2a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1070 Update Ansible structure 60/12660/10
Peter Mikus [Sat, 19 May 2018 13:15:29 +0000 (15:15 +0200)]
CSIT-1070 Update Ansible structure

Change-Id: I9adab174f0c15f4c05a93f61b17714fa6542ea5d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 88/12788/1
Jan Gelety [Tue, 29 May 2018 13:52:45 +0000 (15:52 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~252-g229c1aa~b4334_amd64

- use new vpp ref build - centos7:
  18.07-rc0~252_g229c1aa~b4285.x86_64

Change-Id: I596520740ed93e31617ee382108bcba269771423
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1089: Add SRv6 MRR tests to trending 39/12639/5
Tibor Frank [Fri, 18 May 2018 06:31:39 +0000 (08:31 +0200)]
CSIT-1089: Add SRv6 MRR tests to trending

Change-Id: Id7cf1fd41f10922bce35be97153661cdd41d071b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1106: Unify the anomaly detection (plots, dashboard) 60/12760/5
Tibor Frank [Mon, 28 May 2018 07:02:35 +0000 (09:02 +0200)]
CSIT-1106: Unify the anomaly detection (plots, dashboard)

Change-Id: I27aaa5482224d1ff518aceb879cd889f2fc8d0f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1104: Trending: Speed-up plots generation 36/12736/7
Tibor Frank [Fri, 25 May 2018 07:13:15 +0000 (09:13 +0200)]
CSIT-1104: Trending: Speed-up plots generation

Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC Tests: mark VRF assignment tests as failing (HC2VPP-331) 19/12719/2
Marek Gradzki [Thu, 24 May 2018 11:45:21 +0000 (13:45 +0200)]
HC Tests: mark VRF assignment tests as failing (HC2VPP-331)

Failures might be related to:
https://gerrit.fd.io/r/#/c/12643/

Change-Id: I0c60d51e27508f937a4b2d6c6b5e6f0703f793ab
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: mark unnumbered interface tests as failing (HC2VPP-330) 17/12717/2
Marek Gradzki [Thu, 24 May 2018 11:37:13 +0000 (13:37 +0200)]
HC Tests: mark unnumbered interface tests as failing (HC2VPP-330)

Failures might be related to:
https://gerrit.fd.io/r/#/c/12632/
and/or:
https://gerrit.fd.io/r/#/c/12646/

Change-Id: I529582ef95b6cf752a3f0e98cd0326d4a01d15a8
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoFIX: Trending dashboard 18/12718/2
Tibor Frank [Thu, 24 May 2018 11:37:53 +0000 (13:37 +0200)]
FIX: Trending dashboard

Change-Id: I7634a4074647ef226cd6fb3ac1b5e0ee5376c4d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1101: Optimize input data processing 62/12662/10
Tibor Frank [Mon, 21 May 2018 06:50:42 +0000 (08:50 +0200)]
CSIT-1101: Optimize input data processing

 - Add multiprocessing

Change-Id: Iaeb9dcf0f4523de379ecb7f775b941d9deb080b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd defaultbranch to .gitreview 90/12490/29
Vratko Polak [Wed, 9 May 2018 10:03:05 +0000 (12:03 +0200)]
Add defaultbranch to .gitreview

Without having different values in different branches,
"git review" has trouble contributing to non-master branches.

Change-Id: I4a6797a8646c26bdae49eb4fcc9dbd463b97ab7b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1087: Add SRv6 MRR tests 21/12621/11
Tibor Frank [Thu, 17 May 2018 12:17:20 +0000 (14:17 +0200)]
CSIT-1087: Add SRv6 MRR tests

Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd dot1q into L2-perf triggers 84/12684/2
Peter Mikus [Tue, 22 May 2018 08:08:06 +0000 (08:08 +0000)]
Add dot1q into L2-perf triggers

Change-Id: Idf91005bc1331705c9f5ac9a2b2af59a4fb5a062
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-986: Improve formatting of MDR documentation 79/12679/4
Vratko Polak [Mon, 21 May 2018 14:11:29 +0000 (16:11 +0200)]
CSIT-986: Improve formatting of MDR documentation

Change-Id: I1a67deea51b7ffdc7730a52b56f57baa64747d7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agostart-testcase-DMM file addition 97/12597/3
sharath [Wed, 16 May 2018 12:12:08 +0000 (17:42 +0530)]
start-testcase-DMM file addition

Change-Id: I39945a5f649571267361018659108d107ffb5149
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
5 years agoCSIT-986: MDR rst documentation 68/12268/36
Vratko Polak [Fri, 27 Apr 2018 17:57:13 +0000 (19:57 +0200)]
CSIT-986: MDR rst documentation

+ Introduction.
+ Phases description.
+ Comparison tables.
+ Graphs.

Change-Id: Iec5143770677c733070fb0444a1a7d898f1eb04e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoHC tests: fix 'Archive Honeycomb logs' KW docs 13/12613/2
Marek Gradzki [Thu, 17 May 2018 07:23:03 +0000 (09:23 +0200)]
HC tests: fix 'Archive Honeycomb logs' KW docs

Change-Id: I10851345579ee751b0b79b807fed140e4614685f
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC tests: fix log archive 12/12612/1
Marek Gradzki [Thu, 17 May 2018 07:17:54 +0000 (09:17 +0200)]
HC tests: fix log archive

Use 'Archive Honeycomb logs' instaed of Archive Honeycomb Logs.
The keyword was renamed by https://gerrit.fd.io/r/#/c/12578/

Change-Id: Ic0e2759637ecd0056b7accc3cd96bd8510a2ed14
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: fix CPU layout retrieval in the HC perf job 10/12610/2
Marek Gradzki [Thu, 17 May 2018 06:49:24 +0000 (08:49 +0200)]
HC Tests: fix CPU layout retrieval in the HC perf job

Change-Id: Id99e41a28d01e41d6fb51190d4ab86b667f828af
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086) 92/12592/5
Marek Gradzki [Wed, 16 May 2018 11:08:45 +0000 (13:08 +0200)]
HC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086)

Requires: https://gerrit.fd.io/r/#/c/12516/

Change-Id: Ie0a3452f51fb89914a6a0c53aa4136279a3dfb47
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoTrending: menu 00/12600/1
Tibor Frank [Wed, 16 May 2018 13:35:59 +0000 (15:35 +0200)]
Trending: menu

Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1082: Trending: Display date on the x-axis 93/12593/3
Tibor Frank [Wed, 16 May 2018 11:10:03 +0000 (13:10 +0200)]
CSIT-1082: Trending: Display date on the x-axis

Change-Id: I3f5bdb11222446a5c6016ab4ff57d909514c3ddc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-992: Fix intermediate phases MDR parameter 36/12536/8
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Fix intermediate phases MDR parameter

Also add TODOs and improve comments.

Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoHC tests: archive ODL logs (CSIT-1031) 78/12578/4
Marek Gradzki [Tue, 15 May 2018 08:42:58 +0000 (10:42 +0200)]
HC tests: archive ODL logs (CSIT-1031)

Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1082: Trending: Display date on the x-axis 76/12576/3
Tibor Frank [Tue, 15 May 2018 12:37:20 +0000 (14:37 +0200)]
CSIT-1082: Trending: Display date on the x-axis

Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC tests: archive JOB artifacts to logs.fd.io 73/12573/1
Marek Gradzki [Tue, 15 May 2018 08:31:19 +0000 (10:31 +0200)]
HC tests: archive JOB artifacts to logs.fd.io

Change-Id: I305c9fd0b5653cc749716a8e700fb4c75a9252a6
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC tests: disable NSH plugin (CSIT-994) 72/12572/1
Marek Gradzki [Tue, 15 May 2018 06:30:39 +0000 (08:30 +0200)]
HC tests: disable NSH plugin (CSIT-994)

This reverts https://gerrit.fd.io/r/#/c/12209/

Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 66/12566/1
Tibor Frank [Mon, 14 May 2018 12:35:46 +0000 (14:35 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1036 Expose option to install DKMS in container 52/12552/7
Peter Mikus [Sat, 12 May 2018 13:17:55 +0000 (15:17 +0200)]
CSIT-1036 Expose option to install DKMS in container

Expose DKMS installation as suite variable. This will allow to use DPDK
driver for future tests.

Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files and DPDK_STABLE_VER file 58/12558/2
Jan Gelety [Mon, 14 May 2018 07:01:16 +0000 (09:01 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~169-gab13462~b4246_amd64

- use new vpp ref build - centos7:
  18.07-rc0~169_gab13462~b4201.x86_64

- use new dpdk version:
  18.02.1-vpp1

Change-Id: Ie5da21bb685131fa5741ac394e5013c87b01c904
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 56/12556/1
Tibor Frank [Mon, 14 May 2018 07:00:52 +0000 (09:00 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 41/12541/2
Tibor Frank [Fri, 11 May 2018 13:14:13 +0000 (15:14 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1079 Add multiple mount dirs into container 40/12540/15
Peter Mikus [Fri, 11 May 2018 12:19:34 +0000 (14:19 +0200)]
CSIT-1079 Add multiple mount dirs into container

Pass the list of mount dirs into container LXC/Docker

Change-Id: Ie80062563955273791ab63e156bf0b369e5be649
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1076 Improve SSH connection handling 99/12499/7
Peter Mikus [Wed, 9 May 2018 11:40:12 +0000 (13:40 +0200)]
CSIT-1076 Improve SSH connection handling

Properly detect dropped connection via predicate is_active() to prevent
using dropped connection.

Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-992: Give MDR parameters official names 26/12526/2
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Give MDR parameters official names

Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdated testbed setup readme 72/12372/4
juraj.linkes [Thu, 3 May 2018 09:04:00 +0000 (11:04 +0200)]
Updated testbed setup readme

The section describing PXE server setup contained incorrect paths for
nginx server, which this patch fixes.

Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoCleanup DPDK framework setup 15/12515/6
Peter Mikus [Thu, 10 May 2018 06:38:06 +0000 (08:38 +0200)]
Cleanup DPDK framework setup

Moving installation of DPDK into KW instead of framework setup. This will
unify the framework setup and allow future optimizations.

Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC2VPP-253 - Update routing csit jobs 75/12075/14
Michal Cmarada [Wed, 9 May 2018 12:00:53 +0000 (14:00 +0200)]
HC2VPP-253 - Update routing csit jobs

this fixes test failures caused by HC2VPP routing
models bump (https://gerrit.fd.io/r/#/c/10954)

- updates tests for bgp routing
- updates tests for routing
- updates SLAAC test because of changes in rt-advertisements

Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoCSIT-1071 Add traffic evaluation criteria to MRR 66/12466/8
Peter Mikus [Mon, 7 May 2018 12:42:17 +0000 (14:42 +0200)]
CSIT-1071 Add traffic evaluation criteria to MRR

- Fail the testcase if there is no traffic pass.

Change-Id: I162187073aafa286793ce488fda9fd065bb55213
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Data sources 09/12509/2
Tibor Frank [Wed, 9 May 2018 18:58:56 +0000 (18:58 +0000)]
Report: Data sources

Change-Id: I6c81d52c0b16ae487ab54e89d9bebf1709ff6735
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Data sources 03/12503/1
Tibor Frank [Wed, 9 May 2018 13:28:19 +0000 (15:28 +0200)]
Report: Data sources

Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport 1804: VPP functional test framework changes - centos 95/12495/1
Jan Gelety [Wed, 9 May 2018 10:10:34 +0000 (12:10 +0200)]
Report 1804: VPP functional test framework changes - centos

Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: remove greps 88/12488/2
Tibor Frank [Wed, 9 May 2018 09:26:04 +0000 (11:26 +0200)]
Report: remove greps

Change-Id: I57fee701a99bcdb4f523011fa774c42ecdacdde4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: SSH connect issue 82/12482/4
Peter Mikus [Wed, 9 May 2018 06:16:31 +0000 (06:16 +0000)]
FIX: SSH connect issue

error: [Errno 9] Bad file descriptor

Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Fix greps 85/12485/1
Tibor Frank [Wed, 9 May 2018 07:53:58 +0000 (09:53 +0200)]
Report: Fix greps

Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Small inconsistencies in report sections 63/12463/1
Peter Mikus [Mon, 7 May 2018 11:38:29 +0000 (13:38 +0200)]
FIX: Small inconsistencies in report sections

Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd data point to report 56/12456/2
Peter Mikus [Sun, 6 May 2018 05:59:09 +0000 (05:59 +0000)]
Add data point to report

- MRR Sel, Perf FULL 4

Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agotrending docs: fixed maths formulas format again. 50/12450/1
Maciek Konstantynowicz [Sat, 5 May 2018 21:24:18 +0000 (22:24 +0100)]
trending docs: fixed maths formulas format again.

Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agotrending docs: fixed tables and maths formulas. 48/12448/2
Maciek Konstantynowicz [Sat, 5 May 2018 17:49:27 +0000 (18:49 +0100)]
trending docs: fixed tables and maths formulas.

Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoreport: perf rls notes formatting fixes 49/12449/1
Maciek Konstantynowicz [Sat, 5 May 2018 17:56:29 +0000 (18:56 +0100)]
report: perf rls notes formatting fixes

Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: func rls_notes formatting fixes. 45/12445/1
Maciek Konstantynowicz [Sat, 5 May 2018 15:34:10 +0000 (16:34 +0100)]
Report: func rls_notes formatting fixes.

Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: perf rls_notes formatting fixes. 38/12438/3
Maciek Konstantynowicz [Fri, 4 May 2018 20:47:23 +0000 (21:47 +0100)]
Report: perf rls_notes formatting fixes.

Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: SRv6 to TSA 42/12442/1
Tibor Frank [Sat, 5 May 2018 10:25:51 +0000 (12:25 +0200)]
Report: SRv6 to TSA

Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add SRv6, fix greps 40/12440/2
Tibor Frank [Sat, 5 May 2018 07:13:18 +0000 (09:13 +0200)]
Report: Add SRv6, fix greps

Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoOptimize performance bootstraps 17/11817/10
Peter Mikus [Mon, 16 Apr 2018 10:42:26 +0000 (12:42 +0200)]
Optimize performance bootstraps

- reduce redundant code

Change-Id: Ic5f9f29b18983f116b43bb151c5692ae54f42270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: data, figures desc 34/12434/2
Tibor Frank [Fri, 4 May 2018 17:52:21 +0000 (17:52 +0000)]
Report: data, figures desc

Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-992: Add two suites using optimized search 96/11896/20
Vratko Polak [Fri, 27 Apr 2018 13:11:48 +0000 (15:11 +0200)]
CSIT-992: Add two suites using optimized search

+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.

Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-992: Shorten MDR search test message 15/12415/4
Vratko Polak [Fri, 4 May 2018 11:23:52 +0000 (13:23 +0200)]
CSIT-992: Shorten MDR search test message

Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport 1804: Centos func tests 30/12430/1
Jan Gelety [Fri, 4 May 2018 13:26:36 +0000 (15:26 +0200)]
Report 1804: Centos func tests

Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: data, figures desc 25/12425/1
Tibor Frank [Fri, 4 May 2018 13:05:00 +0000 (15:05 +0200)]
Report: data, figures desc

Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate L2 perf graph section 23/12423/1
Peter Mikus [Fri, 4 May 2018 12:30:24 +0000 (14:30 +0200)]
Update L2 perf graph section

Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-992: Add libraries for optimized search 90/11390/115
Vratko Polak [Fri, 27 Apr 2018 13:11:12 +0000 (15:11 +0200)]
CSIT-992: Add libraries for optimized search

+ Place the libraries into resources/libraries/python/search/.
 + Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
 + for calling the optimized search.
 + for reporting the resulting values.
 + for checking the minimal performance has been reached.
 + for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.

Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add TSA plots 16/12416/1
Tibor Frank [Fri, 4 May 2018 11:41:43 +0000 (13:41 +0200)]
Report: Add TSA plots

Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport rls notes: added ref to trending docs. 09/12409/2
Maciek Konstantynowicz [Fri, 4 May 2018 09:55:21 +0000 (10:55 +0100)]
Report rls notes: added ref to trending docs.

Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoFix various pylint 1.5.4 warnings 87/12187/7
Vratko Polak [Thu, 26 Apr 2018 13:15:51 +0000 (15:15 +0200)]
Fix various pylint 1.5.4 warnings

+ DUTSetup.py:424 Else clause on loop without a break statement
+ InterfaceUtil.py:400 Else clause on loop without a break statement
+ QemuUtils.py:564 Wrong continued indentation
+ SetupDPDKTest.py: Locally enabling broad-except
+ VatExecutor.py: Catching too general exception Exception
+ ssh.py:95 No exception type(s) specified.
+ HTTPRequest.py: Tolerate HTTPCodes.OK
+ multiple: Drop ":returns: None" from docstrings.

There are still several warnings present:
- R0902(too-many-instance-attributes)
- R0912(too-many-branches)
- R0913(too-many-arguments)
- R0914(too-many-locals)
- R0915(too-many-statements)
- R0401(cyclic-import)

And there are multiple blocks of similar lines,
mainly across various Setup*Test.py files:
- R0801(duplicate-code)

Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate release note for rls1804 report 70/12370/7
Peter Mikus [Thu, 3 May 2018 08:14:11 +0000 (10:14 +0200)]
Update release note for rls1804 report

Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TCP perf tests 06/12306/6
Tibor Frank [Wed, 2 May 2018 07:27:17 +0000 (09:27 +0200)]
FIX: TCP perf tests

Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Data, plots, datetime 02/12402/1
Tibor Frank [Fri, 4 May 2018 04:31:05 +0000 (06:31 +0200)]
Report: Data, plots, datetime

Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 95/12395/2
Tibor Frank [Thu, 3 May 2018 19:50:38 +0000 (19:50 +0000)]
Report: Add time to the timestamp

Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 91/12391/2
Tibor Frank [Thu, 3 May 2018 19:22:44 +0000 (19:22 +0000)]
Report: Add time to the timestamp

Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 87/12387/2
Tibor Frank [Thu, 3 May 2018 16:38:50 +0000 (16:38 +0000)]
Report: Add time to the timestamp

Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 81/12381/1
Tibor Frank [Thu, 3 May 2018 13:06:10 +0000 (15:06 +0200)]
Report: Add time to the timestamp

Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: data 74/12374/2
Tibor Frank [Thu, 3 May 2018 10:51:16 +0000 (12:51 +0200)]
Report: data

 - ligato

Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdded .idea to .gitignore 73/12373/1
juraj.linkes [Thu, 3 May 2018 08:55:57 +0000 (10:55 +0200)]
Added .idea to .gitignore

Useful for devs using PyCharm or other IDEA based IDE.

Change-Id: I6edaed293e9214e9370bad67d2321c5113ca7f41
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoReport: data 64/12364/2
Tibor Frank [Thu, 3 May 2018 06:09:42 +0000 (08:09 +0200)]
Report: data

Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: ignore list for the dashboard 59/12359/1
Tibor Frank [Thu, 3 May 2018 04:46:14 +0000 (06:46 +0200)]
Trending: ignore list for the dashboard

Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add MRR detailed results 54/12354/2
Tibor Frank [Wed, 2 May 2018 19:45:00 +0000 (19:45 +0000)]
Report: Add MRR detailed results

Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport 1804: SRv6 adn func part update 50/12250/3
Jan Gelety [Thu, 26 Apr 2018 12:46:56 +0000 (14:46 +0200)]
Report 1804: SRv6 adn func part update

Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>