csit.git
5 years agoCSIT-1104: Trending: Speed-up plots generation 36/12736/7
Tibor Frank [Fri, 25 May 2018 07:13:15 +0000 (09:13 +0200)]
CSIT-1104: Trending: Speed-up plots generation

Change-Id: Ia3916523d4fc9e05ec864af2a858a03dea46c73c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC Tests: mark VRF assignment tests as failing (HC2VPP-331) 19/12719/2
Marek Gradzki [Thu, 24 May 2018 11:45:21 +0000 (13:45 +0200)]
HC Tests: mark VRF assignment tests as failing (HC2VPP-331)

Failures might be related to:
https://gerrit.fd.io/r/#/c/12643/

Change-Id: I0c60d51e27508f937a4b2d6c6b5e6f0703f793ab
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: mark unnumbered interface tests as failing (HC2VPP-330) 17/12717/2
Marek Gradzki [Thu, 24 May 2018 11:37:13 +0000 (13:37 +0200)]
HC Tests: mark unnumbered interface tests as failing (HC2VPP-330)

Failures might be related to:
https://gerrit.fd.io/r/#/c/12632/
and/or:
https://gerrit.fd.io/r/#/c/12646/

Change-Id: I529582ef95b6cf752a3f0e98cd0326d4a01d15a8
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoFIX: Trending dashboard 18/12718/2
Tibor Frank [Thu, 24 May 2018 11:37:53 +0000 (13:37 +0200)]
FIX: Trending dashboard

Change-Id: I7634a4074647ef226cd6fb3ac1b5e0ee5376c4d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1101: Optimize input data processing 62/12662/10
Tibor Frank [Mon, 21 May 2018 06:50:42 +0000 (08:50 +0200)]
CSIT-1101: Optimize input data processing

 - Add multiprocessing

Change-Id: Iaeb9dcf0f4523de379ecb7f775b941d9deb080b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd defaultbranch to .gitreview 90/12490/29
Vratko Polak [Wed, 9 May 2018 10:03:05 +0000 (12:03 +0200)]
Add defaultbranch to .gitreview

Without having different values in different branches,
"git review" has trouble contributing to non-master branches.

Change-Id: I4a6797a8646c26bdae49eb4fcc9dbd463b97ab7b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1087: Add SRv6 MRR tests 21/12621/11
Tibor Frank [Thu, 17 May 2018 12:17:20 +0000 (14:17 +0200)]
CSIT-1087: Add SRv6 MRR tests

Change-Id: Ia90a9bff6791518ba08fa81e6167e96aea7714d5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdd dot1q into L2-perf triggers 84/12684/2
Peter Mikus [Tue, 22 May 2018 08:08:06 +0000 (08:08 +0000)]
Add dot1q into L2-perf triggers

Change-Id: Idf91005bc1331705c9f5ac9a2b2af59a4fb5a062
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-986: Improve formatting of MDR documentation 79/12679/4
Vratko Polak [Mon, 21 May 2018 14:11:29 +0000 (16:11 +0200)]
CSIT-986: Improve formatting of MDR documentation

Change-Id: I1a67deea51b7ffdc7730a52b56f57baa64747d7f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agostart-testcase-DMM file addition 97/12597/3
sharath [Wed, 16 May 2018 12:12:08 +0000 (17:42 +0530)]
start-testcase-DMM file addition

Change-Id: I39945a5f649571267361018659108d107ffb5149
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
5 years agoCSIT-986: MDR rst documentation 68/12268/36
Vratko Polak [Fri, 27 Apr 2018 17:57:13 +0000 (19:57 +0200)]
CSIT-986: MDR rst documentation

+ Introduction.
+ Phases description.
+ Comparison tables.
+ Graphs.

Change-Id: Iec5143770677c733070fb0444a1a7d898f1eb04e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoHC tests: fix 'Archive Honeycomb logs' KW docs 13/12613/2
Marek Gradzki [Thu, 17 May 2018 07:23:03 +0000 (09:23 +0200)]
HC tests: fix 'Archive Honeycomb logs' KW docs

Change-Id: I10851345579ee751b0b79b807fed140e4614685f
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC tests: fix log archive 12/12612/1
Marek Gradzki [Thu, 17 May 2018 07:17:54 +0000 (09:17 +0200)]
HC tests: fix log archive

Use 'Archive Honeycomb logs' instaed of Archive Honeycomb Logs.
The keyword was renamed by https://gerrit.fd.io/r/#/c/12578/

Change-Id: Ic0e2759637ecd0056b7accc3cd96bd8510a2ed14
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: fix CPU layout retrieval in the HC perf job 10/12610/2
Marek Gradzki [Thu, 17 May 2018 06:49:24 +0000 (08:49 +0200)]
HC Tests: fix CPU layout retrieval in the HC perf job

Change-Id: Id99e41a28d01e41d6fb51190d4ab86b667f828af
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086) 92/12592/5
Marek Gradzki [Wed, 16 May 2018 11:08:45 +0000 (13:08 +0200)]
HC Tests: adapt NAT tests to ietf-nat@2018-02-23.yang (CSIT-1086)

Requires: https://gerrit.fd.io/r/#/c/12516/

Change-Id: Ie0a3452f51fb89914a6a0c53aa4136279a3dfb47
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoTrending: menu 00/12600/1
Tibor Frank [Wed, 16 May 2018 13:35:59 +0000 (15:35 +0200)]
Trending: menu

Change-Id: I8f6528f915c96b5aca8482d8b86db5285e9aa1c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1082: Trending: Display date on the x-axis 93/12593/3
Tibor Frank [Wed, 16 May 2018 11:10:03 +0000 (13:10 +0200)]
CSIT-1082: Trending: Display date on the x-axis

Change-Id: I3f5bdb11222446a5c6016ab4ff57d909514c3ddc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-992: Fix intermediate phases MDR parameter 36/12536/8
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Fix intermediate phases MDR parameter

Also add TODOs and improve comments.

Change-Id: I50bd652c83c272c3f7662dd487ab617be2b7de08
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoHC tests: archive ODL logs (CSIT-1031) 78/12578/4
Marek Gradzki [Tue, 15 May 2018 08:42:58 +0000 (10:42 +0200)]
HC tests: archive ODL logs (CSIT-1031)

Change-Id: I444a5d6cd32cb9ee68575dfdb5a208de2c4eb72a
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1082: Trending: Display date on the x-axis 76/12576/3
Tibor Frank [Tue, 15 May 2018 12:37:20 +0000 (14:37 +0200)]
CSIT-1082: Trending: Display date on the x-axis

Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC tests: archive JOB artifacts to logs.fd.io 73/12573/1
Marek Gradzki [Tue, 15 May 2018 08:31:19 +0000 (10:31 +0200)]
HC tests: archive JOB artifacts to logs.fd.io

Change-Id: I305c9fd0b5653cc749716a8e700fb4c75a9252a6
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoHC tests: disable NSH plugin (CSIT-994) 72/12572/1
Marek Gradzki [Tue, 15 May 2018 06:30:39 +0000 (08:30 +0200)]
HC tests: disable NSH plugin (CSIT-994)

This reverts https://gerrit.fd.io/r/#/c/12209/

Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 66/12566/1
Tibor Frank [Mon, 14 May 2018 12:35:46 +0000 (14:35 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1036 Expose option to install DKMS in container 52/12552/7
Peter Mikus [Sat, 12 May 2018 13:17:55 +0000 (15:17 +0200)]
CSIT-1036 Expose option to install DKMS in container

Expose DKMS installation as suite variable. This will allow to use DPDK
driver for future tests.

Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files and DPDK_STABLE_VER file 58/12558/2
Jan Gelety [Mon, 14 May 2018 07:01:16 +0000 (09:01 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~169-gab13462~b4246_amd64

- use new vpp ref build - centos7:
  18.07-rc0~169_gab13462~b4201.x86_64

- use new dpdk version:
  18.02.1-vpp1

Change-Id: Ie5da21bb685131fa5741ac394e5013c87b01c904
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 56/12556/1
Tibor Frank [Mon, 14 May 2018 07:00:52 +0000 (09:00 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1078: Optimize input data files download and processing 41/12541/2
Tibor Frank [Fri, 11 May 2018 13:14:13 +0000 (15:14 +0200)]
CSIT-1078: Optimize input data files download and processing

Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1079 Add multiple mount dirs into container 40/12540/15
Peter Mikus [Fri, 11 May 2018 12:19:34 +0000 (14:19 +0200)]
CSIT-1079 Add multiple mount dirs into container

Pass the list of mount dirs into container LXC/Docker

Change-Id: Ie80062563955273791ab63e156bf0b369e5be649
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1076 Improve SSH connection handling 99/12499/7
Peter Mikus [Wed, 9 May 2018 11:40:12 +0000 (13:40 +0200)]
CSIT-1076 Improve SSH connection handling

Properly detect dropped connection via predicate is_active() to prevent
using dropped connection.

Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-992: Give MDR parameters official names 26/12526/2
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Give MDR parameters official names

Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdated testbed setup readme 72/12372/4
juraj.linkes [Thu, 3 May 2018 09:04:00 +0000 (11:04 +0200)]
Updated testbed setup readme

The section describing PXE server setup contained incorrect paths for
nginx server, which this patch fixes.

Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoCleanup DPDK framework setup 15/12515/6
Peter Mikus [Thu, 10 May 2018 06:38:06 +0000 (08:38 +0200)]
Cleanup DPDK framework setup

Moving installation of DPDK into KW instead of framework setup. This will
unify the framework setup and allow future optimizations.

Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoHC2VPP-253 - Update routing csit jobs 75/12075/14
Michal Cmarada [Wed, 9 May 2018 12:00:53 +0000 (14:00 +0200)]
HC2VPP-253 - Update routing csit jobs

this fixes test failures caused by HC2VPP routing
models bump (https://gerrit.fd.io/r/#/c/10954)

- updates tests for bgp routing
- updates tests for routing
- updates SLAAC test because of changes in rt-advertisements

Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
5 years agoCSIT-1071 Add traffic evaluation criteria to MRR 66/12466/8
Peter Mikus [Mon, 7 May 2018 12:42:17 +0000 (14:42 +0200)]
CSIT-1071 Add traffic evaluation criteria to MRR

- Fail the testcase if there is no traffic pass.

Change-Id: I162187073aafa286793ce488fda9fd065bb55213
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Data sources 09/12509/2
Tibor Frank [Wed, 9 May 2018 18:58:56 +0000 (18:58 +0000)]
Report: Data sources

Change-Id: I6c81d52c0b16ae487ab54e89d9bebf1709ff6735
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Data sources 03/12503/1
Tibor Frank [Wed, 9 May 2018 13:28:19 +0000 (15:28 +0200)]
Report: Data sources

Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport 1804: VPP functional test framework changes - centos 95/12495/1
Jan Gelety [Wed, 9 May 2018 10:10:34 +0000 (12:10 +0200)]
Report 1804: VPP functional test framework changes - centos

Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: remove greps 88/12488/2
Tibor Frank [Wed, 9 May 2018 09:26:04 +0000 (11:26 +0200)]
Report: remove greps

Change-Id: I57fee701a99bcdb4f523011fa774c42ecdacdde4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: SSH connect issue 82/12482/4
Peter Mikus [Wed, 9 May 2018 06:16:31 +0000 (06:16 +0000)]
FIX: SSH connect issue

error: [Errno 9] Bad file descriptor

Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Fix greps 85/12485/1
Tibor Frank [Wed, 9 May 2018 07:53:58 +0000 (09:53 +0200)]
Report: Fix greps

Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Small inconsistencies in report sections 63/12463/1
Peter Mikus [Mon, 7 May 2018 11:38:29 +0000 (13:38 +0200)]
FIX: Small inconsistencies in report sections

Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoAdd data point to report 56/12456/2
Peter Mikus [Sun, 6 May 2018 05:59:09 +0000 (05:59 +0000)]
Add data point to report

- MRR Sel, Perf FULL 4

Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agotrending docs: fixed maths formulas format again. 50/12450/1
Maciek Konstantynowicz [Sat, 5 May 2018 21:24:18 +0000 (22:24 +0100)]
trending docs: fixed maths formulas format again.

Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agotrending docs: fixed tables and maths formulas. 48/12448/2
Maciek Konstantynowicz [Sat, 5 May 2018 17:49:27 +0000 (18:49 +0100)]
trending docs: fixed tables and maths formulas.

Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoreport: perf rls notes formatting fixes 49/12449/1
Maciek Konstantynowicz [Sat, 5 May 2018 17:56:29 +0000 (18:56 +0100)]
report: perf rls notes formatting fixes

Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: func rls_notes formatting fixes. 45/12445/1
Maciek Konstantynowicz [Sat, 5 May 2018 15:34:10 +0000 (16:34 +0100)]
Report: func rls_notes formatting fixes.

Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: perf rls_notes formatting fixes. 38/12438/3
Maciek Konstantynowicz [Fri, 4 May 2018 20:47:23 +0000 (21:47 +0100)]
Report: perf rls_notes formatting fixes.

Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: SRv6 to TSA 42/12442/1
Tibor Frank [Sat, 5 May 2018 10:25:51 +0000 (12:25 +0200)]
Report: SRv6 to TSA

Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add SRv6, fix greps 40/12440/2
Tibor Frank [Sat, 5 May 2018 07:13:18 +0000 (09:13 +0200)]
Report: Add SRv6, fix greps

Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoOptimize performance bootstraps 17/11817/10
Peter Mikus [Mon, 16 Apr 2018 10:42:26 +0000 (12:42 +0200)]
Optimize performance bootstraps

- reduce redundant code

Change-Id: Ic5f9f29b18983f116b43bb151c5692ae54f42270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: data, figures desc 34/12434/2
Tibor Frank [Fri, 4 May 2018 17:52:21 +0000 (17:52 +0000)]
Report: data, figures desc

Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-992: Add two suites using optimized search 96/11896/20
Vratko Polak [Fri, 27 Apr 2018 13:11:48 +0000 (15:11 +0200)]
CSIT-992: Add two suites using optimized search

+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.

Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-992: Shorten MDR search test message 15/12415/4
Vratko Polak [Fri, 4 May 2018 11:23:52 +0000 (13:23 +0200)]
CSIT-992: Shorten MDR search test message

Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport 1804: Centos func tests 30/12430/1
Jan Gelety [Fri, 4 May 2018 13:26:36 +0000 (15:26 +0200)]
Report 1804: Centos func tests

Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: data, figures desc 25/12425/1
Tibor Frank [Fri, 4 May 2018 13:05:00 +0000 (15:05 +0200)]
Report: data, figures desc

Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate L2 perf graph section 23/12423/1
Peter Mikus [Fri, 4 May 2018 12:30:24 +0000 (14:30 +0200)]
Update L2 perf graph section

Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-992: Add libraries for optimized search 90/11390/115
Vratko Polak [Fri, 27 Apr 2018 13:11:12 +0000 (15:11 +0200)]
CSIT-992: Add libraries for optimized search

+ Place the libraries into resources/libraries/python/search/.
 + Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
 + for calling the optimized search.
 + for reporting the resulting values.
 + for checking the minimal performance has been reached.
 + for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.

Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add TSA plots 16/12416/1
Tibor Frank [Fri, 4 May 2018 11:41:43 +0000 (13:41 +0200)]
Report: Add TSA plots

Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport rls notes: added ref to trending docs. 09/12409/2
Maciek Konstantynowicz [Fri, 4 May 2018 09:55:21 +0000 (10:55 +0100)]
Report rls notes: added ref to trending docs.

Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoFix various pylint 1.5.4 warnings 87/12187/7
Vratko Polak [Thu, 26 Apr 2018 13:15:51 +0000 (15:15 +0200)]
Fix various pylint 1.5.4 warnings

+ DUTSetup.py:424 Else clause on loop without a break statement
+ InterfaceUtil.py:400 Else clause on loop without a break statement
+ QemuUtils.py:564 Wrong continued indentation
+ SetupDPDKTest.py: Locally enabling broad-except
+ VatExecutor.py: Catching too general exception Exception
+ ssh.py:95 No exception type(s) specified.
+ HTTPRequest.py: Tolerate HTTPCodes.OK
+ multiple: Drop ":returns: None" from docstrings.

There are still several warnings present:
- R0902(too-many-instance-attributes)
- R0912(too-many-branches)
- R0913(too-many-arguments)
- R0914(too-many-locals)
- R0915(too-many-statements)
- R0401(cyclic-import)

And there are multiple blocks of similar lines,
mainly across various Setup*Test.py files:
- R0801(duplicate-code)

Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate release note for rls1804 report 70/12370/7
Peter Mikus [Thu, 3 May 2018 08:14:11 +0000 (10:14 +0200)]
Update release note for rls1804 report

Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TCP perf tests 06/12306/6
Tibor Frank [Wed, 2 May 2018 07:27:17 +0000 (09:27 +0200)]
FIX: TCP perf tests

Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Data, plots, datetime 02/12402/1
Tibor Frank [Fri, 4 May 2018 04:31:05 +0000 (06:31 +0200)]
Report: Data, plots, datetime

Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 95/12395/2
Tibor Frank [Thu, 3 May 2018 19:50:38 +0000 (19:50 +0000)]
Report: Add time to the timestamp

Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 91/12391/2
Tibor Frank [Thu, 3 May 2018 19:22:44 +0000 (19:22 +0000)]
Report: Add time to the timestamp

Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 87/12387/2
Tibor Frank [Thu, 3 May 2018 16:38:50 +0000 (16:38 +0000)]
Report: Add time to the timestamp

Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 81/12381/1
Tibor Frank [Thu, 3 May 2018 13:06:10 +0000 (15:06 +0200)]
Report: Add time to the timestamp

Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: data 74/12374/2
Tibor Frank [Thu, 3 May 2018 10:51:16 +0000 (12:51 +0200)]
Report: data

 - ligato

Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdded .idea to .gitignore 73/12373/1
juraj.linkes [Thu, 3 May 2018 08:55:57 +0000 (10:55 +0200)]
Added .idea to .gitignore

Useful for devs using PyCharm or other IDEA based IDE.

Change-Id: I6edaed293e9214e9370bad67d2321c5113ca7f41
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoReport: data 64/12364/2
Tibor Frank [Thu, 3 May 2018 06:09:42 +0000 (08:09 +0200)]
Report: data

Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: ignore list for the dashboard 59/12359/1
Tibor Frank [Thu, 3 May 2018 04:46:14 +0000 (06:46 +0200)]
Trending: ignore list for the dashboard

Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add MRR detailed results 54/12354/2
Tibor Frank [Wed, 2 May 2018 19:45:00 +0000 (19:45 +0000)]
Report: Add MRR detailed results

Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport 1804: SRv6 adn func part update 50/12250/3
Jan Gelety [Thu, 26 Apr 2018 12:46:56 +0000 (14:46 +0200)]
Report 1804: SRv6 adn func part update

Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: ignore list for the dashboard 45/12345/2
Tibor Frank [Wed, 2 May 2018 14:26:56 +0000 (16:26 +0200)]
Trending: ignore list for the dashboard

Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Delete xml file when parsed 38/12338/1
Tibor Frank [Wed, 2 May 2018 13:20:38 +0000 (15:20 +0200)]
Report: Delete xml file when parsed

Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add MRR detailed results 37/12337/1
Tibor Frank [Wed, 2 May 2018 08:48:31 +0000 (10:48 +0200)]
Report: Add MRR detailed results

Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Docker container image 35/12335/1
Peter Mikus [Wed, 2 May 2018 06:45:39 +0000 (06:45 +0000)]
FIX: Docker container image

Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 64da7d69dfe8d8f89656dc3dba56b0eaef059020)

5 years agoTrending: Add 2vm tests 26/12326/2
Tibor Frank [Wed, 2 May 2018 12:14:27 +0000 (14:14 +0200)]
Trending: Add 2vm tests

Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Replace copy with move while archiving input files 21/12321/1
Tibor Frank [Wed, 2 May 2018 11:02:04 +0000 (13:02 +0200)]
Report: Replace copy with move while archiving input files

Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 10/12310/2
Tibor Frank [Wed, 2 May 2018 08:51:05 +0000 (10:51 +0200)]
Report: Add data

Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Ligato VPP_AGENT_VERSION 08/12308/1
Peter Mikus [Wed, 2 May 2018 07:23:28 +0000 (07:23 +0000)]
FIX: Ligato VPP_AGENT_VERSION

Change-Id: Ifce0fd94652498302d3e36f6b83453a701784619
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1cdddef1e93f3aa040ae2611456ec5825798d5c6)

5 years agoReport: data 00/12300/1
Tibor Frank [Wed, 2 May 2018 06:51:56 +0000 (08:51 +0200)]
Report: data

Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRemove obsolete NDRPDR checks 77/12077/3
Peter Mikus [Tue, 24 Apr 2018 12:00:04 +0000 (14:00 +0200)]
Remove obsolete NDRPDR checks

Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoTrending docs: fixed formatting tables, lists in methodology. 80/12280/4
Maciek Konstantynowicz [Sun, 29 Apr 2018 18:42:12 +0000 (20:42 +0200)]
Trending docs: fixed formatting tables, lists in methodology.

Change-Id: Ief04ba507b1395cf0d56794190252ae9da020bad
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agorls1804 report: updates to perf rls notes, methodology. 78/12278/2
Maciek Konstantynowicz [Sat, 28 Apr 2018 13:02:10 +0000 (14:02 +0100)]
rls1804 report: updates to perf rls notes, methodology.

Change-Id: I54ef2e63ce03aee509fba7dcbfd1d7faabe6ef91
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrending docs: format and section naming fixes. 79/12279/1
Maciek Konstantynowicz [Sun, 29 Apr 2018 11:55:59 +0000 (12:55 +0100)]
Trending docs: format and section naming fixes.

Change-Id: I891100a7a89bf174df8ac911ba997af8e429a76e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoMore edits in trending docs: methodology, dashboard. 77/12277/2
Maciek Konstantynowicz [Sat, 28 Apr 2018 11:50:59 +0000 (12:50 +0100)]
More edits in trending docs: methodology, dashboard.

Change-Id: I008fd39c57810dcf4cb84e5a9fc4f9adf6923a4f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: Add CentOS func tests 62/12262/2
Tibor Frank [Fri, 27 Apr 2018 16:21:19 +0000 (16:21 +0000)]
Report: Add CentOS func tests

Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoEdits in trending docs: methodology, dashboard. 51/12251/5
Maciek Konstantynowicz [Fri, 27 Apr 2018 11:20:05 +0000 (12:20 +0100)]
Edits in trending docs: methodology, dashboard.

Change-Id: I137f4fd9c0a32435de65c9e25088e6775d6c2dca
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrend dashboard table header fixes adjustments. 59/12259/1
Maciek Konstantynowicz [Fri, 27 Apr 2018 13:40:18 +0000 (14:40 +0100)]
Trend dashboard table header fixes adjustments.

Change-Id: I186e07a53c0de8722584af927ac3b84331e73609
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: Add CentOS func tests 52/12252/2
Tibor Frank [Fri, 27 Apr 2018 11:37:30 +0000 (11:37 +0000)]
Report: Add CentOS func tests

Change-Id: Ib8fae5f152ef11da478f2a8470f20e58bc516aec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC tests: reenable NSH plugin (CSIT-994) 09/12209/2
Marek Gradzki [Thu, 26 Apr 2018 08:11:32 +0000 (10:11 +0200)]
HC tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/11088/

Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoReport: delete tmp dir 44/12244/1
Tibor Frank [Fri, 27 Apr 2018 10:02:33 +0000 (12:02 +0200)]
Report: delete tmp dir

Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: add data 40/12240/1
Tibor Frank [Fri, 27 Apr 2018 09:50:04 +0000 (11:50 +0200)]
Report: add data

Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Do not include last week for long term 35/12235/3
Vratko Polak [Fri, 27 Apr 2018 08:40:09 +0000 (10:40 +0200)]
CSIT-1041: Do not include last week for long term

Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add CentOS func tests 31/12231/1
Tibor Frank [Fri, 27 Apr 2018 08:21:28 +0000 (10:21 +0200)]
Report: Add CentOS func tests

Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Add api-segment conf to TCP tests 02/12102/4
Tibor Frank [Wed, 25 Apr 2018 08:23:18 +0000 (10:23 +0200)]
FIX: Add api-segment conf to TCP tests

Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 21/12221/2
Tibor Frank [Fri, 27 Apr 2018 07:28:29 +0000 (09:28 +0200)]
Report: Add data

Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr 18/12218/2
Jan Gelety [Fri, 27 Apr 2018 07:09:14 +0000 (09:09 +0200)]
FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr

Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1041: Trending dashboard - colours 14/12214/2
Tibor Frank [Fri, 27 Apr 2018 06:21:54 +0000 (08:21 +0200)]
CSIT-1041: Trending dashboard - colours

Change-Id: I781e901e81f201d1335708c99eb52783f349725c
Signed-off-by: Tibor Frank <tifrank@cisco.com>