Marek Gradzki [Tue, 15 May 2018 06:30:39 +0000 (08:30 +0200)]
HC tests: disable NSH plugin (CSIT-994)
This reverts https://gerrit.fd.io/r/#/c/12209/
Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Mon, 14 May 2018 12:35:46 +0000 (14:35 +0200)]
CSIT-1078: Optimize input data files download and processing
Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Sat, 12 May 2018 13:17:55 +0000 (15:17 +0200)]
CSIT-1036 Expose option to install DKMS in container
Expose DKMS installation as suite variable. This will allow to use DPDK
driver for future tests.
Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 14 May 2018 07:01:16 +0000 (09:01 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file
- use new vpp ref build - ubuntu 16.04:
18.07-rc0~
169-gab13462~b4246_amd64
- use new vpp ref build - centos7:
18.07-rc0~169_gab13462~b4201.x86_64
- use new dpdk version:
18.02.1-vpp1
Change-Id: Ie5da21bb685131fa5741ac394e5013c87b01c904
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 14 May 2018 07:00:52 +0000 (09:00 +0200)]
CSIT-1078: Optimize input data files download and processing
Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 11 May 2018 13:14:13 +0000 (15:14 +0200)]
CSIT-1078: Optimize input data files download and processing
Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 11 May 2018 12:19:34 +0000 (14:19 +0200)]
CSIT-1079 Add multiple mount dirs into container
Pass the list of mount dirs into container LXC/Docker
Change-Id: Ie80062563955273791ab63e156bf0b369e5be649
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 9 May 2018 11:40:12 +0000 (13:40 +0200)]
CSIT-1076 Improve SSH connection handling
Properly detect dropped connection via predicate is_active() to prevent
using dropped connection.
Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Give MDR parameters official names
Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
juraj.linkes [Thu, 3 May 2018 09:04:00 +0000 (11:04 +0200)]
Updated testbed setup readme
The section describing PXE server setup contained incorrect paths for
nginx server, which this patch fixes.
Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
Peter Mikus [Thu, 10 May 2018 06:38:06 +0000 (08:38 +0200)]
Cleanup DPDK framework setup
Moving installation of DPDK into KW instead of framework setup. This will
unify the framework setup and allow future optimizations.
Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Michal Cmarada [Wed, 9 May 2018 12:00:53 +0000 (14:00 +0200)]
HC2VPP-253 - Update routing csit jobs
this fixes test failures caused by HC2VPP routing
models bump (https://gerrit.fd.io/r/#/c/10954)
- updates tests for bgp routing
- updates tests for routing
- updates SLAAC test because of changes in rt-advertisements
Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
Peter Mikus [Mon, 7 May 2018 12:42:17 +0000 (14:42 +0200)]
CSIT-1071 Add traffic evaluation criteria to MRR
- Fail the testcase if there is no traffic pass.
Change-Id: I162187073aafa286793ce488fda9fd065bb55213
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 9 May 2018 18:58:56 +0000 (18:58 +0000)]
Report: Data sources
Change-Id: I6c81d52c0b16ae487ab54e89d9bebf1709ff6735
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 9 May 2018 13:28:19 +0000 (15:28 +0200)]
Report: Data sources
Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 9 May 2018 10:10:34 +0000 (12:10 +0200)]
Report 1804: VPP functional test framework changes - centos
Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 9 May 2018 09:26:04 +0000 (11:26 +0200)]
Report: remove greps
Change-Id: I57fee701a99bcdb4f523011fa774c42ecdacdde4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 9 May 2018 06:16:31 +0000 (06:16 +0000)]
FIX: SSH connect issue
error: [Errno 9] Bad file descriptor
Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 9 May 2018 07:53:58 +0000 (09:53 +0200)]
Report: Fix greps
Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 7 May 2018 11:38:29 +0000 (13:38 +0200)]
FIX: Small inconsistencies in report sections
Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sun, 6 May 2018 05:59:09 +0000 (05:59 +0000)]
Add data point to report
- MRR Sel, Perf FULL 4
Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 21:24:18 +0000 (22:24 +0100)]
trending docs: fixed maths formulas format again.
Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 17:49:27 +0000 (18:49 +0100)]
trending docs: fixed tables and maths formulas.
Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 17:56:29 +0000 (18:56 +0100)]
report: perf rls notes formatting fixes
Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 15:34:10 +0000 (16:34 +0100)]
Report: func rls_notes formatting fixes.
Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 4 May 2018 20:47:23 +0000 (21:47 +0100)]
Report: perf rls_notes formatting fixes.
Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Sat, 5 May 2018 10:25:51 +0000 (12:25 +0200)]
Report: SRv6 to TSA
Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Sat, 5 May 2018 07:13:18 +0000 (09:13 +0200)]
Report: Add SRv6, fix greps
Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 16 Apr 2018 10:42:26 +0000 (12:42 +0200)]
Optimize performance bootstraps
- reduce redundant code
Change-Id: Ic5f9f29b18983f116b43bb151c5692ae54f42270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Fri, 4 May 2018 17:52:21 +0000 (17:52 +0000)]
Report: data, figures desc
Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 27 Apr 2018 13:11:48 +0000 (15:11 +0200)]
CSIT-992: Add two suites using optimized search
+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.
Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 4 May 2018 11:23:52 +0000 (13:23 +0200)]
CSIT-992: Shorten MDR search test message
Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 4 May 2018 13:26:36 +0000 (15:26 +0200)]
Report 1804: Centos func tests
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 4 May 2018 13:05:00 +0000 (15:05 +0200)]
Report: data, figures desc
Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 4 May 2018 12:30:24 +0000 (14:30 +0200)]
Update L2 perf graph section
Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Fri, 27 Apr 2018 13:11:12 +0000 (15:11 +0200)]
CSIT-992: Add libraries for optimized search
+ Place the libraries into resources/libraries/python/search/.
+ Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
+ for calling the optimized search.
+ for reporting the resulting values.
+ for checking the minimal performance has been reached.
+ for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.
Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 4 May 2018 11:41:43 +0000 (13:41 +0200)]
Report: Add TSA plots
Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Fri, 4 May 2018 09:55:21 +0000 (10:55 +0100)]
Report rls notes: added ref to trending docs.
Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 26 Apr 2018 13:15:51 +0000 (15:15 +0200)]
Fix various pylint 1.5.4 warnings
+ DUTSetup.py:424 Else clause on loop without a break statement
+ InterfaceUtil.py:400 Else clause on loop without a break statement
+ QemuUtils.py:564 Wrong continued indentation
+ SetupDPDKTest.py: Locally enabling broad-except
+ VatExecutor.py: Catching too general exception Exception
+ ssh.py:95 No exception type(s) specified.
+ HTTPRequest.py: Tolerate HTTPCodes.OK
+ multiple: Drop ":returns: None" from docstrings.
There are still several warnings present:
- R0902(too-many-instance-attributes)
- R0912(too-many-branches)
- R0913(too-many-arguments)
- R0914(too-many-locals)
- R0915(too-many-statements)
- R0401(cyclic-import)
And there are multiple blocks of similar lines,
mainly across various Setup*Test.py files:
- R0801(duplicate-code)
Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 3 May 2018 08:14:11 +0000 (10:14 +0200)]
Update release note for rls1804 report
Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 2 May 2018 07:27:17 +0000 (09:27 +0200)]
FIX: TCP perf tests
Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 4 May 2018 04:31:05 +0000 (06:31 +0200)]
Report: Data, plots, datetime
Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 19:50:38 +0000 (19:50 +0000)]
Report: Add time to the timestamp
Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 19:22:44 +0000 (19:22 +0000)]
Report: Add time to the timestamp
Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 16:38:50 +0000 (16:38 +0000)]
Report: Add time to the timestamp
Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 13:06:10 +0000 (15:06 +0200)]
Report: Add time to the timestamp
Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 10:51:16 +0000 (12:51 +0200)]
Report: data
- ligato
Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
juraj.linkes [Thu, 3 May 2018 08:55:57 +0000 (10:55 +0200)]
Added .idea to .gitignore
Useful for devs using PyCharm or other IDEA based IDE.
Change-Id: I6edaed293e9214e9370bad67d2321c5113ca7f41
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
Tibor Frank [Thu, 3 May 2018 06:09:42 +0000 (08:09 +0200)]
Report: data
Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 04:46:14 +0000 (06:46 +0200)]
Trending: ignore list for the dashboard
Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 19:45:00 +0000 (19:45 +0000)]
Report: Add MRR detailed results
Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 26 Apr 2018 12:46:56 +0000 (14:46 +0200)]
Report 1804: SRv6 adn func part update
Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 2 May 2018 14:26:56 +0000 (16:26 +0200)]
Trending: ignore list for the dashboard
Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 13:20:38 +0000 (15:20 +0200)]
Report: Delete xml file when parsed
Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 08:48:31 +0000 (10:48 +0200)]
Report: Add MRR detailed results
Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 2 May 2018 06:45:39 +0000 (06:45 +0000)]
FIX: Docker container image
Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit
64da7d69dfe8d8f89656dc3dba56b0eaef059020)
Tibor Frank [Wed, 2 May 2018 12:14:27 +0000 (14:14 +0200)]
Trending: Add 2vm tests
Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 11:02:04 +0000 (13:02 +0200)]
Report: Replace copy with move while archiving input files
Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 08:51:05 +0000 (10:51 +0200)]
Report: Add data
Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 2 May 2018 07:23:28 +0000 (07:23 +0000)]
FIX: Ligato VPP_AGENT_VERSION
Change-Id: Ifce0fd94652498302d3e36f6b83453a701784619
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit
1cdddef1e93f3aa040ae2611456ec5825798d5c6)
Tibor Frank [Wed, 2 May 2018 06:51:56 +0000 (08:51 +0200)]
Report: data
Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 24 Apr 2018 12:00:04 +0000 (14:00 +0200)]
Remove obsolete NDRPDR checks
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Sun, 29 Apr 2018 18:42:12 +0000 (20:42 +0200)]
Trending docs: fixed formatting tables, lists in methodology.
Change-Id: Ief04ba507b1395cf0d56794190252ae9da020bad
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 28 Apr 2018 13:02:10 +0000 (14:02 +0100)]
rls1804 report: updates to perf rls notes, methodology.
Change-Id: I54ef2e63ce03aee509fba7dcbfd1d7faabe6ef91
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sun, 29 Apr 2018 11:55:59 +0000 (12:55 +0100)]
Trending docs: format and section naming fixes.
Change-Id: I891100a7a89bf174df8ac911ba997af8e429a76e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 28 Apr 2018 11:50:59 +0000 (12:50 +0100)]
More edits in trending docs: methodology, dashboard.
Change-Id: I008fd39c57810dcf4cb84e5a9fc4f9adf6923a4f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 16:21:19 +0000 (16:21 +0000)]
Report: Add CentOS func tests
Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Fri, 27 Apr 2018 11:20:05 +0000 (12:20 +0100)]
Edits in trending docs: methodology, dashboard.
Change-Id: I137f4fd9c0a32435de65c9e25088e6775d6c2dca
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 27 Apr 2018 13:40:18 +0000 (14:40 +0100)]
Trend dashboard table header fixes adjustments.
Change-Id: I186e07a53c0de8722584af927ac3b84331e73609
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 11:37:30 +0000 (11:37 +0000)]
Report: Add CentOS func tests
Change-Id: Ib8fae5f152ef11da478f2a8470f20e58bc516aec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Marek Gradzki [Thu, 26 Apr 2018 08:11:32 +0000 (10:11 +0200)]
HC tests: reenable NSH plugin (CSIT-994)
Reverts https://gerrit.fd.io/r/#/c/11088/
Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 10:02:33 +0000 (12:02 +0200)]
Report: delete tmp dir
Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 09:50:04 +0000 (11:50 +0200)]
Report: add data
Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 27 Apr 2018 08:40:09 +0000 (10:40 +0200)]
CSIT-1041: Do not include last week for long term
Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 08:21:28 +0000 (10:21 +0200)]
Report: Add CentOS func tests
Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 08:23:18 +0000 (10:23 +0200)]
FIX: Add api-segment conf to TCP tests
Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 07:28:29 +0000 (09:28 +0200)]
Report: Add data
Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Fri, 27 Apr 2018 07:09:14 +0000 (09:09 +0200)]
FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 06:21:54 +0000 (08:21 +0200)]
CSIT-1041: Trending dashboard - colours
Change-Id: I781e901e81f201d1335708c99eb52783f349725c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 25 Apr 2018 21:17:55 +0000 (22:17 +0100)]
New section: trending analysis methodology
Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 26 Apr 2018 16:35:58 +0000 (18:35 +0200)]
Trending: switch back to 3*stdev
Reporting many fake pro/regressions is worse
then missing few of the real ones.
Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 18:10:17 +0000 (18:10 +0000)]
Report: Add historical data to performance changes table
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 15:56:31 +0000 (15:56 +0000)]
Report: Add historical data to performance changes table
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 12:11:11 +0000 (14:11 +0200)]
Report: Add historical data to performance changes table
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 11:09:11 +0000 (13:09 +0200)]
CSIT-1041: Trending dashboard
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 10:34:28 +0000 (12:34 +0200)]
Trending: use 2*stdev
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 10:27:32 +0000 (12:27 +0200)]
Report: remove VPP unit tests
Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 10:18:35 +0000 (12:18 +0200)]
Report: Add data
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 08:08:42 +0000 (10:08 +0200)]
Report: Add historical data to performance changes table
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 06:33:06 +0000 (08:33 +0200)]
Report: Add historical data to performance changes table
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 25 Apr 2018 15:35:52 +0000 (17:35 +0200)]
CSIT-1041: Use TMM for trending line
+ Make also pro/re-gression detection use TMM.
+ Update graphs.
- Do not update dashboard tables yet.
Change-Id: Iae526c846b329ad99549be61481532e197704fb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 24 Apr 2018 11:36:20 +0000 (13:36 +0200)]
Update report content
- Update report content to match with rls1804 and master
Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 17:25:30 +0000 (17:25 +0000)]
CSIT-1041: Trending dashboard
Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 15:21:50 +0000 (17:21 +0200)]
CSIT-1041: Trending dashboard
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 13:28:14 +0000 (15:28 +0200)]
CSIT-1041: Trending dashboard
Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 24 Apr 2018 12:27:30 +0000 (14:27 +0200)]
CSIT-1041: Do not treat positive jumps as outliers
Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Wed, 25 Apr 2018 12:36:47 +0000 (13:36 +0100)]
Edits of intro to perf trending dashboard
Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Fri, 13 Apr 2018 17:45:33 +0000 (19:45 +0200)]
Fix warnings reported by gen_doc.sh
+ Docstring warnings fixed.
+ Multiline param descriptions indented by 4 spaces.
- Except the PacketVerifier.py one
- I have tried several quote-like blocks, nothing works.
- Rst warnings not fixed.
- How can I fix them? They refer to temporarily created files.
+ Other improvements:
+ Python lines no longer than 80 characters.
+ :return: -> :returns:
+ Notes before params.
+ :raises
+ closing colon after exception class.
+ Description is a sentence.
+ Present tense in conditional sentences.
+ Bumped copyright year in edited files.
Change-Id: I462c194eeecb666dc146e26858486a07c990be9b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 08:39:47 +0000 (10:39 +0200)]
Report: add data
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/17/
- https://jenkins.fd.io/job/csit-vpp-perf-1804-all/18/
Change-Id: I3cfebb535c1c1806530ec16e86a5088a94ce3141
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 25 Apr 2018 06:36:52 +0000 (08:36 +0200)]
FIX: SSH socket reading error
Currently if the command timeouts due to the nature of script execution
we are trying to again read from socket after timeout on seesion
expired. This patch is supposed to fix the behaviour and eliminate the
second read from channel after it was cloed.
Change-Id: Ib0028e901eb6ff4d10ca77d2ea19f9e770e6cef4
Signed-off-by: Peter Mikus <pmikus@cisco.com>