csit.git
5 years agoAdd data point to report 56/12456/2
Peter Mikus [Sun, 6 May 2018 05:59:09 +0000 (05:59 +0000)]
Add data point to report

- MRR Sel, Perf FULL 4

Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agotrending docs: fixed maths formulas format again. 50/12450/1
Maciek Konstantynowicz [Sat, 5 May 2018 21:24:18 +0000 (22:24 +0100)]
trending docs: fixed maths formulas format again.

Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agotrending docs: fixed tables and maths formulas. 48/12448/2
Maciek Konstantynowicz [Sat, 5 May 2018 17:49:27 +0000 (18:49 +0100)]
trending docs: fixed tables and maths formulas.

Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoreport: perf rls notes formatting fixes 49/12449/1
Maciek Konstantynowicz [Sat, 5 May 2018 17:56:29 +0000 (18:56 +0100)]
report: perf rls notes formatting fixes

Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: func rls_notes formatting fixes. 45/12445/1
Maciek Konstantynowicz [Sat, 5 May 2018 15:34:10 +0000 (16:34 +0100)]
Report: func rls_notes formatting fixes.

Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: perf rls_notes formatting fixes. 38/12438/3
Maciek Konstantynowicz [Fri, 4 May 2018 20:47:23 +0000 (21:47 +0100)]
Report: perf rls_notes formatting fixes.

Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: SRv6 to TSA 42/12442/1
Tibor Frank [Sat, 5 May 2018 10:25:51 +0000 (12:25 +0200)]
Report: SRv6 to TSA

Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add SRv6, fix greps 40/12440/2
Tibor Frank [Sat, 5 May 2018 07:13:18 +0000 (09:13 +0200)]
Report: Add SRv6, fix greps

Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoOptimize performance bootstraps 17/11817/10
Peter Mikus [Mon, 16 Apr 2018 10:42:26 +0000 (12:42 +0200)]
Optimize performance bootstraps

- reduce redundant code

Change-Id: Ic5f9f29b18983f116b43bb151c5692ae54f42270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: data, figures desc 34/12434/2
Tibor Frank [Fri, 4 May 2018 17:52:21 +0000 (17:52 +0000)]
Report: data, figures desc

Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-992: Add two suites using optimized search 96/11896/20
Vratko Polak [Fri, 27 Apr 2018 13:11:48 +0000 (15:11 +0200)]
CSIT-992: Add two suites using optimized search

+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.

Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-992: Shorten MDR search test message 15/12415/4
Vratko Polak [Fri, 4 May 2018 11:23:52 +0000 (13:23 +0200)]
CSIT-992: Shorten MDR search test message

Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport 1804: Centos func tests 30/12430/1
Jan Gelety [Fri, 4 May 2018 13:26:36 +0000 (15:26 +0200)]
Report 1804: Centos func tests

Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: data, figures desc 25/12425/1
Tibor Frank [Fri, 4 May 2018 13:05:00 +0000 (15:05 +0200)]
Report: data, figures desc

Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate L2 perf graph section 23/12423/1
Peter Mikus [Fri, 4 May 2018 12:30:24 +0000 (14:30 +0200)]
Update L2 perf graph section

Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-992: Add libraries for optimized search 90/11390/115
Vratko Polak [Fri, 27 Apr 2018 13:11:12 +0000 (15:11 +0200)]
CSIT-992: Add libraries for optimized search

+ Place the libraries into resources/libraries/python/search/.
 + Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
 + for calling the optimized search.
 + for reporting the resulting values.
 + for checking the minimal performance has been reached.
 + for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.

Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add TSA plots 16/12416/1
Tibor Frank [Fri, 4 May 2018 11:41:43 +0000 (13:41 +0200)]
Report: Add TSA plots

Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport rls notes: added ref to trending docs. 09/12409/2
Maciek Konstantynowicz [Fri, 4 May 2018 09:55:21 +0000 (10:55 +0100)]
Report rls notes: added ref to trending docs.

Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoFix various pylint 1.5.4 warnings 87/12187/7
Vratko Polak [Thu, 26 Apr 2018 13:15:51 +0000 (15:15 +0200)]
Fix various pylint 1.5.4 warnings

+ DUTSetup.py:424 Else clause on loop without a break statement
+ InterfaceUtil.py:400 Else clause on loop without a break statement
+ QemuUtils.py:564 Wrong continued indentation
+ SetupDPDKTest.py: Locally enabling broad-except
+ VatExecutor.py: Catching too general exception Exception
+ ssh.py:95 No exception type(s) specified.
+ HTTPRequest.py: Tolerate HTTPCodes.OK
+ multiple: Drop ":returns: None" from docstrings.

There are still several warnings present:
- R0902(too-many-instance-attributes)
- R0912(too-many-branches)
- R0913(too-many-arguments)
- R0914(too-many-locals)
- R0915(too-many-statements)
- R0401(cyclic-import)

And there are multiple blocks of similar lines,
mainly across various Setup*Test.py files:
- R0801(duplicate-code)

Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate release note for rls1804 report 70/12370/7
Peter Mikus [Thu, 3 May 2018 08:14:11 +0000 (10:14 +0200)]
Update release note for rls1804 report

Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: TCP perf tests 06/12306/6
Tibor Frank [Wed, 2 May 2018 07:27:17 +0000 (09:27 +0200)]
FIX: TCP perf tests

Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Data, plots, datetime 02/12402/1
Tibor Frank [Fri, 4 May 2018 04:31:05 +0000 (06:31 +0200)]
Report: Data, plots, datetime

Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 95/12395/2
Tibor Frank [Thu, 3 May 2018 19:50:38 +0000 (19:50 +0000)]
Report: Add time to the timestamp

Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 91/12391/2
Tibor Frank [Thu, 3 May 2018 19:22:44 +0000 (19:22 +0000)]
Report: Add time to the timestamp

Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 87/12387/2
Tibor Frank [Thu, 3 May 2018 16:38:50 +0000 (16:38 +0000)]
Report: Add time to the timestamp

Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add time to the timestamp 81/12381/1
Tibor Frank [Thu, 3 May 2018 13:06:10 +0000 (15:06 +0200)]
Report: Add time to the timestamp

Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: data 74/12374/2
Tibor Frank [Thu, 3 May 2018 10:51:16 +0000 (12:51 +0200)]
Report: data

 - ligato

Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdded .idea to .gitignore 73/12373/1
juraj.linkes [Thu, 3 May 2018 08:55:57 +0000 (10:55 +0200)]
Added .idea to .gitignore

Useful for devs using PyCharm or other IDEA based IDE.

Change-Id: I6edaed293e9214e9370bad67d2321c5113ca7f41
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
5 years agoReport: data 64/12364/2
Tibor Frank [Thu, 3 May 2018 06:09:42 +0000 (08:09 +0200)]
Report: data

Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: ignore list for the dashboard 59/12359/1
Tibor Frank [Thu, 3 May 2018 04:46:14 +0000 (06:46 +0200)]
Trending: ignore list for the dashboard

Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add MRR detailed results 54/12354/2
Tibor Frank [Wed, 2 May 2018 19:45:00 +0000 (19:45 +0000)]
Report: Add MRR detailed results

Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport 1804: SRv6 adn func part update 50/12250/3
Jan Gelety [Thu, 26 Apr 2018 12:46:56 +0000 (14:46 +0200)]
Report 1804: SRv6 adn func part update

Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: ignore list for the dashboard 45/12345/2
Tibor Frank [Wed, 2 May 2018 14:26:56 +0000 (16:26 +0200)]
Trending: ignore list for the dashboard

Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Delete xml file when parsed 38/12338/1
Tibor Frank [Wed, 2 May 2018 13:20:38 +0000 (15:20 +0200)]
Report: Delete xml file when parsed

Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add MRR detailed results 37/12337/1
Tibor Frank [Wed, 2 May 2018 08:48:31 +0000 (10:48 +0200)]
Report: Add MRR detailed results

Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Docker container image 35/12335/1
Peter Mikus [Wed, 2 May 2018 06:45:39 +0000 (06:45 +0000)]
FIX: Docker container image

Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 64da7d69dfe8d8f89656dc3dba56b0eaef059020)

5 years agoTrending: Add 2vm tests 26/12326/2
Tibor Frank [Wed, 2 May 2018 12:14:27 +0000 (14:14 +0200)]
Trending: Add 2vm tests

Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Replace copy with move while archiving input files 21/12321/1
Tibor Frank [Wed, 2 May 2018 11:02:04 +0000 (13:02 +0200)]
Report: Replace copy with move while archiving input files

Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 10/12310/2
Tibor Frank [Wed, 2 May 2018 08:51:05 +0000 (10:51 +0200)]
Report: Add data

Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Ligato VPP_AGENT_VERSION 08/12308/1
Peter Mikus [Wed, 2 May 2018 07:23:28 +0000 (07:23 +0000)]
FIX: Ligato VPP_AGENT_VERSION

Change-Id: Ifce0fd94652498302d3e36f6b83453a701784619
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit 1cdddef1e93f3aa040ae2611456ec5825798d5c6)

5 years agoReport: data 00/12300/1
Tibor Frank [Wed, 2 May 2018 06:51:56 +0000 (08:51 +0200)]
Report: data

Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoRemove obsolete NDRPDR checks 77/12077/3
Peter Mikus [Tue, 24 Apr 2018 12:00:04 +0000 (14:00 +0200)]
Remove obsolete NDRPDR checks

Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoTrending docs: fixed formatting tables, lists in methodology. 80/12280/4
Maciek Konstantynowicz [Sun, 29 Apr 2018 18:42:12 +0000 (20:42 +0200)]
Trending docs: fixed formatting tables, lists in methodology.

Change-Id: Ief04ba507b1395cf0d56794190252ae9da020bad
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agorls1804 report: updates to perf rls notes, methodology. 78/12278/2
Maciek Konstantynowicz [Sat, 28 Apr 2018 13:02:10 +0000 (14:02 +0100)]
rls1804 report: updates to perf rls notes, methodology.

Change-Id: I54ef2e63ce03aee509fba7dcbfd1d7faabe6ef91
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrending docs: format and section naming fixes. 79/12279/1
Maciek Konstantynowicz [Sun, 29 Apr 2018 11:55:59 +0000 (12:55 +0100)]
Trending docs: format and section naming fixes.

Change-Id: I891100a7a89bf174df8ac911ba997af8e429a76e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoMore edits in trending docs: methodology, dashboard. 77/12277/2
Maciek Konstantynowicz [Sat, 28 Apr 2018 11:50:59 +0000 (12:50 +0100)]
More edits in trending docs: methodology, dashboard.

Change-Id: I008fd39c57810dcf4cb84e5a9fc4f9adf6923a4f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: Add CentOS func tests 62/12262/2
Tibor Frank [Fri, 27 Apr 2018 16:21:19 +0000 (16:21 +0000)]
Report: Add CentOS func tests

Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoEdits in trending docs: methodology, dashboard. 51/12251/5
Maciek Konstantynowicz [Fri, 27 Apr 2018 11:20:05 +0000 (12:20 +0100)]
Edits in trending docs: methodology, dashboard.

Change-Id: I137f4fd9c0a32435de65c9e25088e6775d6c2dca
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrend dashboard table header fixes adjustments. 59/12259/1
Maciek Konstantynowicz [Fri, 27 Apr 2018 13:40:18 +0000 (14:40 +0100)]
Trend dashboard table header fixes adjustments.

Change-Id: I186e07a53c0de8722584af927ac3b84331e73609
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: Add CentOS func tests 52/12252/2
Tibor Frank [Fri, 27 Apr 2018 11:37:30 +0000 (11:37 +0000)]
Report: Add CentOS func tests

Change-Id: Ib8fae5f152ef11da478f2a8470f20e58bc516aec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoHC tests: reenable NSH plugin (CSIT-994) 09/12209/2
Marek Gradzki [Thu, 26 Apr 2018 08:11:32 +0000 (10:11 +0200)]
HC tests: reenable NSH plugin (CSIT-994)

Reverts https://gerrit.fd.io/r/#/c/11088/

Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
5 years agoReport: delete tmp dir 44/12244/1
Tibor Frank [Fri, 27 Apr 2018 10:02:33 +0000 (12:02 +0200)]
Report: delete tmp dir

Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: add data 40/12240/1
Tibor Frank [Fri, 27 Apr 2018 09:50:04 +0000 (11:50 +0200)]
Report: add data

Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Do not include last week for long term 35/12235/3
Vratko Polak [Fri, 27 Apr 2018 08:40:09 +0000 (10:40 +0200)]
CSIT-1041: Do not include last week for long term

Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add CentOS func tests 31/12231/1
Tibor Frank [Fri, 27 Apr 2018 08:21:28 +0000 (10:21 +0200)]
Report: Add CentOS func tests

Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Add api-segment conf to TCP tests 02/12102/4
Tibor Frank [Wed, 25 Apr 2018 08:23:18 +0000 (10:23 +0200)]
FIX: Add api-segment conf to TCP tests

Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 21/12221/2
Tibor Frank [Fri, 27 Apr 2018 07:28:29 +0000 (09:28 +0200)]
Report: Add data

Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr 18/12218/2
Jan Gelety [Fri, 27 Apr 2018 07:09:14 +0000 (09:09 +0200)]
FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr

Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1041: Trending dashboard - colours 14/12214/2
Tibor Frank [Fri, 27 Apr 2018 06:21:54 +0000 (08:21 +0200)]
CSIT-1041: Trending dashboard - colours

Change-Id: I781e901e81f201d1335708c99eb52783f349725c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoNew section: trending analysis methodology 44/12144/4
Maciek Konstantynowicz [Wed, 25 Apr 2018 21:17:55 +0000 (22:17 +0100)]
New section: trending analysis methodology

Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoTrending: switch back to 3*stdev 93/12193/2
Vratko Polak [Thu, 26 Apr 2018 16:35:58 +0000 (18:35 +0200)]
Trending: switch back to 3*stdev

Reporting many fake pro/regressions is worse
then missing few of the real ones.

Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Add historical data to performance changes table 96/12196/2
Tibor Frank [Thu, 26 Apr 2018 18:10:17 +0000 (18:10 +0000)]
Report: Add historical data to performance changes table

Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add historical data to performance changes table 88/12188/2
Tibor Frank [Thu, 26 Apr 2018 15:56:31 +0000 (15:56 +0000)]
Report: Add historical data to performance changes table

Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add historical data to performance changes table 83/12183/1
Tibor Frank [Thu, 26 Apr 2018 12:11:11 +0000 (14:11 +0200)]
Report: Add historical data to performance changes table

Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 79/12179/1
Tibor Frank [Thu, 26 Apr 2018 11:09:11 +0000 (13:09 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: use 2*stdev 75/12175/1
Tibor Frank [Thu, 26 Apr 2018 10:34:28 +0000 (12:34 +0200)]
Trending: use 2*stdev

Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: remove VPP unit tests 71/12171/1
Tibor Frank [Thu, 26 Apr 2018 10:27:32 +0000 (12:27 +0200)]
Report: remove VPP unit tests

Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add data 67/12167/2
Tibor Frank [Thu, 26 Apr 2018 10:18:35 +0000 (12:18 +0200)]
Report: Add data

Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add historical data to performance changes table 58/12158/2
Tibor Frank [Thu, 26 Apr 2018 08:08:42 +0000 (10:08 +0200)]
Report: Add historical data to performance changes table

Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Add historical data to performance changes table 51/12151/1
Tibor Frank [Thu, 26 Apr 2018 06:33:06 +0000 (08:33 +0200)]
Report: Add historical data to performance changes table

Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Use TMM for trending line 81/12081/6
Vratko Polak [Wed, 25 Apr 2018 15:35:52 +0000 (17:35 +0200)]
CSIT-1041: Use TMM for trending line

+ Make also pro/re-gression detection use TMM.
+ Update graphs.
- Do not update dashboard tables yet.

Change-Id: Iae526c846b329ad99549be61481532e197704fb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate report content 74/12074/2
Peter Mikus [Tue, 24 Apr 2018 11:36:20 +0000 (13:36 +0200)]
Update report content

- Update report content to match with rls1804 and master

Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1041: Trending dashboard 35/12135/2
Tibor Frank [Wed, 25 Apr 2018 17:25:30 +0000 (17:25 +0000)]
CSIT-1041: Trending dashboard

Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 27/12127/1
Tibor Frank [Wed, 25 Apr 2018 15:21:50 +0000 (17:21 +0200)]
CSIT-1041: Trending dashboard

Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 19/12119/1
Tibor Frank [Wed, 25 Apr 2018 13:28:14 +0000 (15:28 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Do not treat positive jumps as outliers 80/12080/4
Vratko Polak [Tue, 24 Apr 2018 12:27:30 +0000 (14:27 +0200)]
CSIT-1041: Do not treat positive jumps as outliers

Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoEdits of intro to perf trending dashboard 11/12111/1
Maciek Konstantynowicz [Wed, 25 Apr 2018 12:36:47 +0000 (13:36 +0100)]
Edits of intro to perf trending dashboard

Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoFix warnings reported by gen_doc.sh 80/11580/10
Vratko Polak [Fri, 13 Apr 2018 17:45:33 +0000 (19:45 +0200)]
Fix warnings reported by gen_doc.sh

+ Docstring warnings fixed.
 + Multiline param descriptions indented by 4 spaces.
 - Except the PacketVerifier.py one
  - I have tried several quote-like blocks, nothing works.
- Rst warnings not fixed.
 - How can I fix them? They refer to temporarily created files.
+ Other improvements:
 + Python lines no longer than 80 characters.
 + :return: -> :returns:
 + Notes before params.
 + :raises
  + closing colon after exception class.
  + Description is a sentence.
  + Present tense in conditional sentences.
+ Bumped copyright year in edited files.

Change-Id: I462c194eeecb666dc146e26858486a07c990be9b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: add data 03/12103/1
Tibor Frank [Wed, 25 Apr 2018 08:39:47 +0000 (10:39 +0200)]
Report: add data

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/

Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: SSH socket reading error 95/12095/2
Peter Mikus [Wed, 25 Apr 2018 06:36:52 +0000 (08:36 +0200)]
FIX: SSH socket reading error

Currently if the command timeouts due to the nature of script execution
we are trying to again read from socket after timeout on seesion
expired. This patch is supposed to fix the behaviour and eliminate the
second read from channel after it was cloed.

Change-Id: Ib0028e901eb6ff4d10ca77d2ea19f9e770e6cef4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Do not ignore zeros while creating csv file 96/12096/1
Tibor Frank [Wed, 25 Apr 2018 06:48:02 +0000 (08:48 +0200)]
FIX: Do not ignore zeros while creating csv file

Change-Id: I0f1f63b9969399258c44176e6ed5a326fd0a5549
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Remove feature plots from base graphs 91/12091/1
Tibor Frank [Wed, 25 Apr 2018 06:27:29 +0000 (08:27 +0200)]
FIX: Remove feature plots from base graphs

Change-Id: I4118a19bd6204858e96cbf8029aea045478efca7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1019: Fix PacketVerifier.RxQueue receive timeout issue 30/11530/5
Lucian Banu [Thu, 5 Apr 2018 05:05:53 +0000 (07:05 +0200)]
CSIT-1019: Fix PacketVerifier.RxQueue receive timeout issue

Change-Id: I0f7f54e721843b0252ac969ddfabc769a632c1a0
Signed-off-by: Lucian Banu <lucian.banu@enea.com>
5 years agoReport: Add data sources 66/12066/1
Tibor Frank [Tue, 24 Apr 2018 09:04:35 +0000 (11:04 +0200)]
Report: Add data sources

 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/14/
 - https://jenkins.fd.io/job/csit-vpp-perf-1804-all/16/

Change-Id: I7603a41f797a6dd5438c3daa40e883b1643ae712
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 61/12061/1
Tibor Frank [Tue, 24 Apr 2018 08:39:38 +0000 (10:39 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I815e61432d418d0f741ed57f5450460951f7191f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUse /64 prefix for IPv6 subnet on vhost interface 82/11882/2
Neale Ranns [Wed, 18 Apr 2018 13:50:19 +0000 (06:50 -0700)]
Use /64 prefix for IPv6 subnet on vhost interface

Change-Id: Iee512d6f5c107e7b2e5fdc7412e07d34a1c6bbd0
Signed-off-by: Neale Ranns <nranns@cisco.com>
5 years agoCSIT-1041: Trending dashboard 57/12057/2
Tibor Frank [Tue, 24 Apr 2018 07:31:21 +0000 (09:31 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I1e05f75545d97ab186fbc48df44bfe17472d6cfd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: TCP perf tests 44/12044/2
Tibor Frank [Tue, 24 Apr 2018 06:07:47 +0000 (08:07 +0200)]
FIX: TCP perf tests

Change-Id: I6424722641b0cefdf1945b57996bf2c48dc86a3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 40/12040/1
Tibor Frank [Tue, 24 Apr 2018 05:28:44 +0000 (07:28 +0200)]
CSIT-1041: Trending dashboard

Change-Id: Ida3dfcc4a7ae21424e7f6b6db597a80bc633b9da
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 17/12017/1
Tibor Frank [Mon, 23 Apr 2018 14:57:44 +0000 (16:57 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I8d53c68643acb18bf2b5ab171672b0de02d2d135
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: fix performance comparision tables 08/12008/1
Tibor Frank [Mon, 23 Apr 2018 11:41:51 +0000 (13:41 +0200)]
Report: fix performance comparision tables

Change-Id: Ieae746412427980fb86512253cc58ebcee991317
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 04/12004/2
Tibor Frank [Mon, 23 Apr 2018 11:30:48 +0000 (13:30 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I3b8e545bd198281af502acc6e23268e840112423
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1009: SRv6 proxy tests 99/11399/34
Jan Gelety [Thu, 22 Mar 2018 12:51:33 +0000 (13:51 +0100)]
CSIT-1009: SRv6 proxy tests

- SRv6 with endpoint to SR-unaware Service Function via static proxy
- SRv6 with endpoint to SR-unaware Service Function via dynamic proxy
- SRv6 with endpoint to SR-unaware Service Function via masquerading proxy

Change-Id: I6a6062cb41d810bf9e27dacfd866181bfde4c693
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1041: Trending dashboard 98/11998/1
Tibor Frank [Mon, 23 Apr 2018 10:20:20 +0000 (12:20 +0200)]
CSIT-1041: Trending dashboard

Change-Id: I99b7acbbf6c773a4d2c5fc74cf7ba02aa6f98fa3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: data 94/11994/1
Tibor Frank [Mon, 23 Apr 2018 09:47:39 +0000 (11:47 +0200)]
Report: data

Change-Id: I63a4a6f65aa80a4edb11b1ea3ece9787a148f6f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate of VPP_STABLE_VER files 84/11984/2
Jan Gelety [Mon, 23 Apr 2018 07:08:39 +0000 (09:08 +0200)]
Update of VPP_STABLE_VER files

- use new vpp ref build - ubuntu 16.04:
  18.07-rc0~81-g00cd22d~b4139_amd64

- use new vpp ref build - centos7:
  18.07-rc0~81_g00cd22d~b4106.x86_64

Change-Id: I9a86d6535c1bdbdf7865dfa1e0aac85c54457fa5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: data 89/11989/1
Tibor Frank [Mon, 23 Apr 2018 08:02:24 +0000 (10:02 +0200)]
Report: data

Change-Id: I3fd24ba9030a62f9307a24e8774e703fa8232692
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1041: Trending dashboard 85/11985/2
Tibor Frank [Mon, 23 Apr 2018 07:29:29 +0000 (09:29 +0200)]
CSIT-1041: Trending dashboard

 - add long term classification

Change-Id: Iec8d2275c01da3b1e41435b9abfb70ec3fe98fd3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoPAL Trending: fix in remove_outliers 80/11980/1
Tibor Frank [Mon, 23 Apr 2018 06:17:35 +0000 (08:17 +0200)]
PAL Trending: fix in remove_outliers

Change-Id: Iec4d1683b8bb97224971d803821aced3c37144bd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: Use rolling window for outlier detection 63/11963/3
Vratko Polak [Fri, 20 Apr 2018 12:23:11 +0000 (14:23 +0200)]
FIX: Use rolling window for outlier detection

+ Rename find_outliers to split_outliers.
+ Make remove_ouliers call split_outliers internally.
+ Add "window" argument to both functions.
+ Add TODOs to call sites not setting window size explicitly.
+ Improve docstrings.

Change-Id: I24961e2859ddbfa62b543031284517c7389a2abb
Signed-off-by: Vratko Polak <vrpolak@cisco.com>