Tibor Frank [Tue, 15 May 2018 12:37:20 +0000 (14:37 +0200)]
CSIT-1082: Trending: Display date on the x-axis
Change-Id: I6f7238e15545d46ded668b7e85f9e2cc58d43586
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Marek Gradzki [Tue, 15 May 2018 08:31:19 +0000 (10:31 +0200)]
HC tests: archive JOB artifacts to logs.fd.io
Change-Id: I305c9fd0b5653cc749716a8e700fb4c75a9252a6
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Marek Gradzki [Tue, 15 May 2018 06:30:39 +0000 (08:30 +0200)]
HC tests: disable NSH plugin (CSIT-994)
This reverts https://gerrit.fd.io/r/#/c/12209/
Change-Id: I1de4ce6e96644881aa14adf6765e8a67b286595d
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Mon, 14 May 2018 12:35:46 +0000 (14:35 +0200)]
CSIT-1078: Optimize input data files download and processing
Change-Id: I973238d98d549555c0d43c91f9fd96a9209065ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Sat, 12 May 2018 13:17:55 +0000 (15:17 +0200)]
CSIT-1036 Expose option to install DKMS in container
Expose DKMS installation as suite variable. This will allow to use DPDK
driver for future tests.
Change-Id: I38fd014c8cf6f4bf42881af2196cadc679fe53e0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 14 May 2018 07:01:16 +0000 (09:01 +0200)]
Update of VPP_STABLE_VER files and DPDK_STABLE_VER file
- use new vpp ref build - ubuntu 16.04:
18.07-rc0~
169-gab13462~b4246_amd64
- use new vpp ref build - centos7:
18.07-rc0~169_gab13462~b4201.x86_64
- use new dpdk version:
18.02.1-vpp1
Change-Id: Ie5da21bb685131fa5741ac394e5013c87b01c904
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 14 May 2018 07:00:52 +0000 (09:00 +0200)]
CSIT-1078: Optimize input data files download and processing
Change-Id: I3fa3c09bc485416e6d2be02fac296d83da16e0d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 11 May 2018 13:14:13 +0000 (15:14 +0200)]
CSIT-1078: Optimize input data files download and processing
Change-Id: Id1b0af996c4b77878621cfc8c262795f51e537fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 11 May 2018 12:19:34 +0000 (14:19 +0200)]
CSIT-1079 Add multiple mount dirs into container
Pass the list of mount dirs into container LXC/Docker
Change-Id: Ie80062563955273791ab63e156bf0b369e5be649
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 9 May 2018 11:40:12 +0000 (13:40 +0200)]
CSIT-1076 Improve SSH connection handling
Properly detect dropped connection via predicate is_active() to prevent
using dropped connection.
Change-Id: I9105622f28d2f7949675b8cee1dd4384a12f72a9
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Thu, 10 May 2018 17:27:30 +0000 (19:27 +0200)]
CSIT-992: Give MDR parameters official names
Change-Id: I1da9a64fb06e015f2b2a0aacb46a53d70349b4b6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
juraj.linkes [Thu, 3 May 2018 09:04:00 +0000 (11:04 +0200)]
Updated testbed setup readme
The section describing PXE server setup contained incorrect paths for
nginx server, which this patch fixes.
Change-Id: Iea04c12baea88d6ef378826d4b4e2eab5648b36b
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
Peter Mikus [Thu, 10 May 2018 06:38:06 +0000 (08:38 +0200)]
Cleanup DPDK framework setup
Moving installation of DPDK into KW instead of framework setup. This will
unify the framework setup and allow future optimizations.
Change-Id: I360ba95a2858e73e4bbb12020567d5d174ab69ca
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Michal Cmarada [Wed, 9 May 2018 12:00:53 +0000 (14:00 +0200)]
HC2VPP-253 - Update routing csit jobs
this fixes test failures caused by HC2VPP routing
models bump (https://gerrit.fd.io/r/#/c/10954)
- updates tests for bgp routing
- updates tests for routing
- updates SLAAC test because of changes in rt-advertisements
Change-Id: Iacc37b42e6523f440d77241c18ca8e61d1d01f23
Signed-off-by: Michal Cmarada <michal.cmarada@pantheon.tech>
Peter Mikus [Mon, 7 May 2018 12:42:17 +0000 (14:42 +0200)]
CSIT-1071 Add traffic evaluation criteria to MRR
- Fail the testcase if there is no traffic pass.
Change-Id: I162187073aafa286793ce488fda9fd065bb55213
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 9 May 2018 18:58:56 +0000 (18:58 +0000)]
Report: Data sources
Change-Id: I6c81d52c0b16ae487ab54e89d9bebf1709ff6735
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 9 May 2018 13:28:19 +0000 (15:28 +0200)]
Report: Data sources
Change-Id: I7b3b3451c71cf6912b760660f2af9856c576ecca
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 9 May 2018 10:10:34 +0000 (12:10 +0200)]
Report 1804: VPP functional test framework changes - centos
Change-Id: I9ada32945c87cb2bb6ef4fd1ef6e5c1cb54f6f32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 9 May 2018 09:26:04 +0000 (11:26 +0200)]
Report: remove greps
Change-Id: I57fee701a99bcdb4f523011fa774c42ecdacdde4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 9 May 2018 06:16:31 +0000 (06:16 +0000)]
FIX: SSH connect issue
error: [Errno 9] Bad file descriptor
Change-Id: I4c5278d41e979f6af43054e3b5890fb154555494
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 9 May 2018 07:53:58 +0000 (09:53 +0200)]
Report: Fix greps
Change-Id: I450d5e9fa1cbd4a40caec68f3fc4674f744f1168
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 7 May 2018 11:38:29 +0000 (13:38 +0200)]
FIX: Small inconsistencies in report sections
Change-Id: I0c27300678414bd3baecccd8e51ca0dc15af73d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Sun, 6 May 2018 05:59:09 +0000 (05:59 +0000)]
Add data point to report
- MRR Sel, Perf FULL 4
Change-Id: Idc016488fd656726e54d6dbd661dd877d481fd59
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 21:24:18 +0000 (22:24 +0100)]
trending docs: fixed maths formulas format again.
Change-Id: Ia9031e720bddf783a26d25de1ed189bf3b09312f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 17:49:27 +0000 (18:49 +0100)]
trending docs: fixed tables and maths formulas.
Change-Id: Iad93e7a57655835ee1a75664f142d3fd362f5313
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 17:56:29 +0000 (18:56 +0100)]
report: perf rls notes formatting fixes
Change-Id: I075528061822206d17b83cc4b1d475419c4084f9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 5 May 2018 15:34:10 +0000 (16:34 +0100)]
Report: func rls_notes formatting fixes.
Change-Id: Ib138227a02335c67513bdb85ceb6200d1dcc9eff
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 4 May 2018 20:47:23 +0000 (21:47 +0100)]
Report: perf rls_notes formatting fixes.
Change-Id: I9f9ba3c59ab007d687f4e268ce91b046b731c850
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Sat, 5 May 2018 10:25:51 +0000 (12:25 +0200)]
Report: SRv6 to TSA
Change-Id: I23d7080db24ef579ad53420cbe1bacd10f2db873
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Sat, 5 May 2018 07:13:18 +0000 (09:13 +0200)]
Report: Add SRv6, fix greps
Change-Id: I55fea325dbc54bc6f2f2e42f0b6166d68f2e7300
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Mon, 16 Apr 2018 10:42:26 +0000 (12:42 +0200)]
Optimize performance bootstraps
- reduce redundant code
Change-Id: Ic5f9f29b18983f116b43bb151c5692ae54f42270
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Fri, 4 May 2018 17:52:21 +0000 (17:52 +0000)]
Report: data, figures desc
Change-Id: I720376c377940a3497da8c33e7ee1f909d293fd4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 27 Apr 2018 13:11:48 +0000 (15:11 +0200)]
CSIT-992: Add two suites using optimized search
+ Add 10ge2p1x520-ethip4-ip4base-ndrpdr.robot
+ Add 10ge2p1x520-eth-l2bdbasemaclrn-eth-2vhostvr1024-1vm-ndrpdr.robot
+ Make sure both IMIX and 9000B test cases are there.
+ Document NDRPDR test tag.
+ Execute some of NDRPDR tests daily.
Change-Id: I66427d49cb6b8304fde4e8d91606de33b624186a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 4 May 2018 11:23:52 +0000 (13:23 +0200)]
CSIT-992: Shorten MDR search test message
Change-Id: I79c78d4d8ca1611a287bd117e480c4317d27e287
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Fri, 4 May 2018 13:26:36 +0000 (15:26 +0200)]
Report 1804: Centos func tests
Change-Id: Ifc6febd239c0c3c5e2c29e26992120c2d6d1b0b4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 4 May 2018 13:05:00 +0000 (15:05 +0200)]
Report: data, figures desc
Change-Id: I6751b6ae833610456e1dea938d5262c28b93439d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Fri, 4 May 2018 12:30:24 +0000 (14:30 +0200)]
Update L2 perf graph section
Change-Id: Iaeff80bd9454e99a97b2d8aeb13450ac06f650ae
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Vratko Polak [Fri, 27 Apr 2018 13:11:12 +0000 (15:11 +0200)]
CSIT-992: Add libraries for optimized search
+ Place the libraries into resources/libraries/python/search/.
+ Except OptimizedTrexSearch in TrafficGenerator.py
+ Change traffic generator to support floats for duration and warmup.
+ Remove explicit type conversions where not needed.
+ Add robot keywords to performance_utils.robot
+ for calling the optimized search.
+ for reporting the resulting values.
+ for checking the minimal performance has been reached.
+ for running five second "Traffic should pass with no loss" after the search.
- Add methodology documentation in subsequent Change.
- Add simulator for testing algorithm correctness in a subsequent Change.
- Add tests using the libraries in subsequent Change.
Change-Id: Ia041008382ee4c9a562172099aea794c854d5f2f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 4 May 2018 11:41:43 +0000 (13:41 +0200)]
Report: Add TSA plots
Change-Id: Ibb8da96518848fef2fc5b0002a84391dea81c573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Fri, 4 May 2018 09:55:21 +0000 (10:55 +0100)]
Report rls notes: added ref to trending docs.
Change-Id: I4690a4e5f9ca9ba34d3f51b2b2068e9007558839
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 26 Apr 2018 13:15:51 +0000 (15:15 +0200)]
Fix various pylint 1.5.4 warnings
+ DUTSetup.py:424 Else clause on loop without a break statement
+ InterfaceUtil.py:400 Else clause on loop without a break statement
+ QemuUtils.py:564 Wrong continued indentation
+ SetupDPDKTest.py: Locally enabling broad-except
+ VatExecutor.py: Catching too general exception Exception
+ ssh.py:95 No exception type(s) specified.
+ HTTPRequest.py: Tolerate HTTPCodes.OK
+ multiple: Drop ":returns: None" from docstrings.
There are still several warnings present:
- R0902(too-many-instance-attributes)
- R0912(too-many-branches)
- R0913(too-many-arguments)
- R0914(too-many-locals)
- R0915(too-many-statements)
- R0401(cyclic-import)
And there are multiple blocks of similar lines,
mainly across various Setup*Test.py files:
- R0801(duplicate-code)
Change-Id: I582575cb52b85d69d268e6374852f6e74bb71052
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Thu, 3 May 2018 08:14:11 +0000 (10:14 +0200)]
Update release note for rls1804 report
Change-Id: I3e80997ace8073edc90f662f6393bd62005fc815
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 2 May 2018 07:27:17 +0000 (09:27 +0200)]
FIX: TCP perf tests
Change-Id: I59ad8ef70fc2bedce14b52359922a002f960ab7a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 4 May 2018 04:31:05 +0000 (06:31 +0200)]
Report: Data, plots, datetime
Change-Id: I941fd53fdfc35a88562689dacd08aa2ec28429fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 19:50:38 +0000 (19:50 +0000)]
Report: Add time to the timestamp
Change-Id: I323517fbac177ef31861be747feeb81968d2b330
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 19:22:44 +0000 (19:22 +0000)]
Report: Add time to the timestamp
Change-Id: I5d48fb578195d584c3d51a2b8e0d9770ffe82182
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 16:38:50 +0000 (16:38 +0000)]
Report: Add time to the timestamp
Change-Id: I1343e84353230329362848d1389ae41b169d2791
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 13:06:10 +0000 (15:06 +0200)]
Report: Add time to the timestamp
Change-Id: I72379462b31455a03f461598cd4b0084b52c4b3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 10:51:16 +0000 (12:51 +0200)]
Report: data
- ligato
Change-Id: I4c54d57e3364fa7cad63d7019e6daed8b6ef885b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
juraj.linkes [Thu, 3 May 2018 08:55:57 +0000 (10:55 +0200)]
Added .idea to .gitignore
Useful for devs using PyCharm or other IDEA based IDE.
Change-Id: I6edaed293e9214e9370bad67d2321c5113ca7f41
Signed-off-by: juraj.linkes <juraj.linkes@pantheon.tech>
Tibor Frank [Thu, 3 May 2018 06:09:42 +0000 (08:09 +0200)]
Report: data
Change-Id: I5330c643a3c8ec4115287bf341af1d07175b4e79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 3 May 2018 04:46:14 +0000 (06:46 +0200)]
Trending: ignore list for the dashboard
Change-Id: I93e09bd7655a39d1e873cc8c54032469be9cd573
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 19:45:00 +0000 (19:45 +0000)]
Report: Add MRR detailed results
Change-Id: Ia0a12da56b7873b3ec9f8555609828b71addccd0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 26 Apr 2018 12:46:56 +0000 (14:46 +0200)]
Report 1804: SRv6 adn func part update
Change-Id: I3091299269c84ba2a7487cf5a5e8145df26e78e4
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 2 May 2018 14:26:56 +0000 (16:26 +0200)]
Trending: ignore list for the dashboard
Change-Id: Ibdb134517097bc9cacdcb75a11dda59290ab4e21
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 13:20:38 +0000 (15:20 +0200)]
Report: Delete xml file when parsed
Change-Id: Ie28c3f3fb58a76ada1cf292ba4c8a401d0ec7155
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 08:48:31 +0000 (10:48 +0200)]
Report: Add MRR detailed results
Change-Id: Ib34689d0a9560c2adc8f9c7e464f5fbf4a2ae1f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 2 May 2018 06:45:39 +0000 (06:45 +0000)]
FIX: Docker container image
Change-Id: I127fe11b9095fb24a536dce7d6c26c7e7fd4be4e
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit
64da7d69dfe8d8f89656dc3dba56b0eaef059020)
Tibor Frank [Wed, 2 May 2018 12:14:27 +0000 (14:14 +0200)]
Trending: Add 2vm tests
Change-Id: Ifc008ba50c4c84e781c12dc3080d3a361090efb6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 11:02:04 +0000 (13:02 +0200)]
Report: Replace copy with move while archiving input files
Change-Id: Iea741cf3346574cc5def8c13e2660e2760157487
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 2 May 2018 08:51:05 +0000 (10:51 +0200)]
Report: Add data
Change-Id: Id860fe218da5fd608aba163588e92c28b4c8cb53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 2 May 2018 07:23:28 +0000 (07:23 +0000)]
FIX: Ligato VPP_AGENT_VERSION
Change-Id: Ifce0fd94652498302d3e36f6b83453a701784619
Signed-off-by: Peter Mikus <pmikus@cisco.com>
(cherry picked from commit
1cdddef1e93f3aa040ae2611456ec5825798d5c6)
Tibor Frank [Wed, 2 May 2018 06:51:56 +0000 (08:51 +0200)]
Report: data
Change-Id: If58c7bebaedc772fb7b8d7376f2118bad848b2cc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 24 Apr 2018 12:00:04 +0000 (14:00 +0200)]
Remove obsolete NDRPDR checks
Change-Id: If495493f4dce8d2eecfb8c06bcd587f315b70b1d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Maciek Konstantynowicz [Sun, 29 Apr 2018 18:42:12 +0000 (20:42 +0200)]
Trending docs: fixed formatting tables, lists in methodology.
Change-Id: Ief04ba507b1395cf0d56794190252ae9da020bad
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 28 Apr 2018 13:02:10 +0000 (14:02 +0100)]
rls1804 report: updates to perf rls notes, methodology.
Change-Id: I54ef2e63ce03aee509fba7dcbfd1d7faabe6ef91
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sun, 29 Apr 2018 11:55:59 +0000 (12:55 +0100)]
Trending docs: format and section naming fixes.
Change-Id: I891100a7a89bf174df8ac911ba997af8e429a76e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Sat, 28 Apr 2018 11:50:59 +0000 (12:50 +0100)]
More edits in trending docs: methodology, dashboard.
Change-Id: I008fd39c57810dcf4cb84e5a9fc4f9adf6923a4f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 16:21:19 +0000 (16:21 +0000)]
Report: Add CentOS func tests
Change-Id: I2e993738306ee0a5435c0fda7e46de300fcc91fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Fri, 27 Apr 2018 11:20:05 +0000 (12:20 +0100)]
Edits in trending docs: methodology, dashboard.
Change-Id: I137f4fd9c0a32435de65c9e25088e6775d6c2dca
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Fri, 27 Apr 2018 13:40:18 +0000 (14:40 +0100)]
Trend dashboard table header fixes adjustments.
Change-Id: I186e07a53c0de8722584af927ac3b84331e73609
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 11:37:30 +0000 (11:37 +0000)]
Report: Add CentOS func tests
Change-Id: Ib8fae5f152ef11da478f2a8470f20e58bc516aec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Marek Gradzki [Thu, 26 Apr 2018 08:11:32 +0000 (10:11 +0200)]
HC tests: reenable NSH plugin (CSIT-994)
Reverts https://gerrit.fd.io/r/#/c/11088/
Change-Id: Ib7b70d33f4a8110656dd39f25b7f5a67a2f52104
Signed-off-by: Marek Gradzki <mgradzki@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 10:02:33 +0000 (12:02 +0200)]
Report: delete tmp dir
Change-Id: I6ab1eefa9a53419d47fda829c365ce9fab7db3c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 09:50:04 +0000 (11:50 +0200)]
Report: add data
Change-Id: Ic1c072f41ed967855214570f7b7dbbcacc2a6295
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 27 Apr 2018 08:40:09 +0000 (10:40 +0200)]
CSIT-1041: Do not include last week for long term
Change-Id: Ib7682f24ce22e2e3dc3de74dcef6f70c1785d1c8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 08:21:28 +0000 (10:21 +0200)]
Report: Add CentOS func tests
Change-Id: Id8e08778f199535cec013d08c0b4ab51e51e5d27
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 08:23:18 +0000 (10:23 +0200)]
FIX: Add api-segment conf to TCP tests
Change-Id: Idf778d8427c8dabf716090cdaeba189e8cccfb98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 07:28:29 +0000 (09:28 +0200)]
Report: Add data
Change-Id: I9bce23e0430f5b4b375cdc814251a95245897a53
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Fri, 27 Apr 2018 07:09:14 +0000 (09:09 +0200)]
FIX: tc12-IMIX-4t4c-eth-l2bdbasemaclrn-mrr
Change-Id: I193411e97f069982fca8408e5e5a42cd577586ed
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 27 Apr 2018 06:21:54 +0000 (08:21 +0200)]
CSIT-1041: Trending dashboard - colours
Change-Id: I781e901e81f201d1335708c99eb52783f349725c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 25 Apr 2018 21:17:55 +0000 (22:17 +0100)]
New section: trending analysis methodology
Change-Id: I09ec04759a5f1f01c3835349c3ae094ae459226e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Thu, 26 Apr 2018 16:35:58 +0000 (18:35 +0200)]
Trending: switch back to 3*stdev
Reporting many fake pro/regressions is worse
then missing few of the real ones.
Change-Id: I2b23ae14ac4462b993dff8d1b15fb1e472caf490
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 18:10:17 +0000 (18:10 +0000)]
Report: Add historical data to performance changes table
Change-Id: Ia1e224ecade79c54b373ba3e8ac53c21c054f648
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 15:56:31 +0000 (15:56 +0000)]
Report: Add historical data to performance changes table
Change-Id: I6ae8d3a36ada557a2119f6e7f46dde040e4db574
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 12:11:11 +0000 (14:11 +0200)]
Report: Add historical data to performance changes table
Change-Id: If7bce2c86b2fb352368c433c5db81a4a4bc976ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 11:09:11 +0000 (13:09 +0200)]
CSIT-1041: Trending dashboard
Change-Id: I7aa7f01738649fc3f3b10572d7e08af580293748
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 10:34:28 +0000 (12:34 +0200)]
Trending: use 2*stdev
Change-Id: I24ba8d268a25d5b5c249cde47a13468dfab57a4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 10:27:32 +0000 (12:27 +0200)]
Report: remove VPP unit tests
Change-Id: I1fb0dd1e2d135fab29014d627e003e08ff0a98d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 10:18:35 +0000 (12:18 +0200)]
Report: Add data
Change-Id: I043a50f9d55dd784039a483da034cfe4db65d003
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 08:08:42 +0000 (10:08 +0200)]
Report: Add historical data to performance changes table
Change-Id: I9d6ff6021db4356c0b06555c79841b9ed602f671
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 26 Apr 2018 06:33:06 +0000 (08:33 +0200)]
Report: Add historical data to performance changes table
Change-Id: Ia29ff844e44575020e71fb3f613e77508bda8b24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 25 Apr 2018 15:35:52 +0000 (17:35 +0200)]
CSIT-1041: Use TMM for trending line
+ Make also pro/re-gression detection use TMM.
+ Update graphs.
- Do not update dashboard tables yet.
Change-Id: Iae526c846b329ad99549be61481532e197704fb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Tue, 24 Apr 2018 11:36:20 +0000 (13:36 +0200)]
Update report content
- Update report content to match with rls1804 and master
Change-Id: Ib50df2482635f07c94ba92f0ed766bd95bc8e52c
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 17:25:30 +0000 (17:25 +0000)]
CSIT-1041: Trending dashboard
Change-Id: If2e06d59fa8986ccf24abc118628b42d1deb6e39
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 15:21:50 +0000 (17:21 +0200)]
CSIT-1041: Trending dashboard
Change-Id: Ib1307d542ddef1fb6c4ddc0f6204c549870a3c25
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 25 Apr 2018 13:28:14 +0000 (15:28 +0200)]
CSIT-1041: Trending dashboard
Change-Id: I1d6aae1839a9d6d44407c90ff257bc37495f0cfa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 24 Apr 2018 12:27:30 +0000 (14:27 +0200)]
CSIT-1041: Do not treat positive jumps as outliers
Change-Id: If6e65faae3b5a31c56f942a7975b5a35f5f6d6a4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Maciek Konstantynowicz [Wed, 25 Apr 2018 12:36:47 +0000 (13:36 +0100)]
Edits of intro to perf trending dashboard
Change-Id: Ide9a38ac5798ba5a2c37f42232dc86b186502085
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Vratko Polak [Fri, 13 Apr 2018 17:45:33 +0000 (19:45 +0200)]
Fix warnings reported by gen_doc.sh
+ Docstring warnings fixed.
+ Multiline param descriptions indented by 4 spaces.
- Except the PacketVerifier.py one
- I have tried several quote-like blocks, nothing works.
- Rst warnings not fixed.
- How can I fix them? They refer to temporarily created files.
+ Other improvements:
+ Python lines no longer than 80 characters.
+ :return: -> :returns:
+ Notes before params.
+ :raises
+ closing colon after exception class.
+ Description is a sentence.
+ Present tense in conditional sentences.
+ Bumped copyright year in edited files.
Change-Id: I462c194eeecb666dc146e26858486a07c990be9b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Code Review / csit.git / log