Maciek Konstantynowicz [Tue, 29 Jan 2019 21:35:56 +0000 (21:35 +0000)]
report: Methodology section, added forwarded modes, tunnel encaps and features.
Change-Id: Idfc575be1549a1ae41a2c384ca582e5a891ff899
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Thu, 31 Jan 2019 08:37:11 +0000 (08:37 +0000)]
Add TB23 back into production pool
Change-Id: I69a16b1baa5147f22b7c5742c2ccf6e030474937
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 30 Jan 2019 19:26:50 +0000 (19:26 +0000)]
FIX: SRv6 container tests
Change-Id: I9ec04608a9b6cf6a99c938b06261e23e58d290be
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 30 Jan 2019 15:08:49 +0000 (15:08 +0000)]
FIX: Hardcode nf_density RXQ count to 1
Change-Id: I7ca3b2ce4f4c9d8b452d9de63e7466482d15aa50
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Mon, 28 Jan 2019 20:57:00 +0000 (20:57 +0000)]
FIX: Cleanup mechanics for vpp_device
Change-Id: Ice975127f8ecdd4cead418151cf37d61dfb218a0
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Wed, 30 Jan 2019 08:31:39 +0000 (09:31 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.04-rc0~
97-g7da100b~b6231
- use new vpp ref build - centos7:
19.04-rc0~97_g7da100b~b6044
- use new vpp ref build - ubuntu 18.04:
19.04-rc0~
97-g7da100bd~b1980
Change-Id: I8e3931e0b46a144445f62afc771a9afb7a341a7a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 30 Jan 2019 09:30:53 +0000 (09:30 +0000)]
FIX: Put back sleep to wait for container to boot.
Change-Id: Id63fc8670c7816cc71d8d6d8704ff7f1adf3db65
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 30 Jan 2019 08:57:29 +0000 (08:57 +0000)]
Remove non-runable nf_density tests
Remove tests that cannot run on target machines
Change-Id: I2417d491e36afc9164c6981a9f5a3134529df251
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Fri, 25 Jan 2019 20:17:54 +0000 (20:17 +0000)]
CSIT-1409 Implement pipeline configuration for l2bd with memif/ip4.
Change-Id: I7463d47a9d65069332eb2a288ff44f4499a8a467
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Tue, 29 Jan 2019 08:32:03 +0000 (09:32 +0100)]
Add 2n1l-10ge2p1x710-eth-l2xcbase-eth-2vhostvr1024-1vm-soak
Change-Id: I6a045225b0ff3cc4cd9880ee05861fd7bf36c61a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 30 Nov 2018 13:49:10 +0000 (14:49 +0100)]
PLRsearch: Initial implementation and suites
Missing bits:
- Add up-to-date .rst document (in child Change).
- Prepare for releasing to PyPI.org (in child Change):
-- Either copy dependencies from MLRsearch, or list in requirements.
-- Perhaps move common dependencies to separate package
for both search to depend on.
-- All the other metadata stuff.
Jira: CSIT-1276
Change-Id: I277efdb63dbb90b30e11f4e30a82e2130ac8efc3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Peter Mikus [Mon, 28 Jan 2019 13:51:41 +0000 (13:51 +0000)]
FIX: CPU util for NF
- Fix detecting total allocable CPUs for NFs
Change-Id: If3345518befb887655d3e162551c49df3163ed92
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Wed, 16 Jan 2019 07:18:02 +0000 (07:18 +0000)]
CSIT-1403 Implement multichain configuration for l2bd with memif/ip4.
Change-Id: Ia87156b2ba826eb0a9a93d756b9765c7373ca6ce
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Mon, 28 Jan 2019 12:31:07 +0000 (12:31 +0000)]
WORKAROUND: Remove static mbufs
Due to incomming changes in https://gerrit.fd.io/r/#/c/16638/
We need to temporarily disable mbuf static.
Change-Id: I629584ef7bf2a7efcacab6b3d90c0bab92aa9e5b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Mon, 28 Jan 2019 09:53:50 +0000 (10:53 +0100)]
FIX: skip tap tests due to changes API
Change-Id: Icc703c7055047b81a8281776c78752f145d9d004
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Mon, 28 Jan 2019 08:56:46 +0000 (08:56 +0000)]
FIX: Semiweekly/weekly bootstrap after VPP rename
Change-Id: I987f365abc2af839bb0b49f0cece9bc556fe11af
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Tue, 22 Jan 2019 15:31:56 +0000 (15:31 +0000)]
CSIT-1407 FIX vpp install after VPP changes
Change-Id: I9148f6de75c3100f827eedec48c4c0ccb343bc54
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Thu, 24 Jan 2019 11:31:25 +0000 (12:31 +0100)]
FIX: correct call of vpp_add_route
Change-Id: I63a2b5f484ac627c020e30c9f01a868c57aacf42
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 23 Jan 2019 15:03:58 +0000 (16:03 +0100)]
Fix tag in 2n-10ge2p1x710-eth-l2bd-8vhost-1chain-4vm-l3fwdip4-mrr
Change-Id: Iaa268043c04a994647c5dcd704e4e61f4f83050c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 23 Jan 2019 15:15:04 +0000 (16:15 +0100)]
Report: Add VSC data
Change-Id: I6cd99129ba41fc34f46714c9540299d0b954c965
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 23 Jan 2019 09:59:29 +0000 (10:59 +0100)]
Fix PyLint errors
Change-Id: I5a369f4b9f9b478375fda4a634bf57cc9623e972
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Wed, 23 Jan 2019 12:52:09 +0000 (12:52 +0000)]
Updated RF tag documentation file with svc density tags, other minor edits.
Change-Id: Iece74d5e7e380db344005a6035252bbe18925646
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 23 Jan 2019 12:28:03 +0000 (13:28 +0100)]
Report: fix specification file
Change-Id: Iae93d648b8d146ee363f5dbb3514edd90c74460a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 22 Jan 2019 13:46:51 +0000 (13:46 +0000)]
NF density: added new TAGs, renamed test suites and test cases per final agreed scheme.
Change-Id: Ia7bbfe5f7027c18a68408cc71445a2839b6b19a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Wed, 23 Jan 2019 08:49:39 +0000 (09:49 +0100)]
Report: Add CSC and VSC data
Change-Id: Ia2ebe3d0b96d0012361082d1f45b5c3853db3640
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Thu, 10 Jan 2019 10:53:58 +0000 (11:53 +0100)]
VPP_Device - add baseline tests - part IIb)
CSIT-1372
Add following baseline tests to VPP_Device:
- ip4
eth2p-ethip4-ip4base-eth-2memif-1dcr-dev
- ip6
eth2p-ethip6-ip6base-eth-2memif-1dcr-dev
- l2bd
eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev
- l2xc
eth2p-eth-l2xcbase-eth-2memif-1dcr-dev
Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Tue, 22 Jan 2019 12:04:01 +0000 (13:04 +0100)]
CSIT-1404: Add data pre-processing for "service density" graphs
Change-Id: If9c1a9ee3cf21640e2153b52693903c29791c7ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 22 Jan 2019 10:24:01 +0000 (11:24 +0100)]
CSIT-1404: Add data pre-processing for "service density" graphs
Change-Id: Icd5709cd627999bc3ecc101abffb2ace3afdb246
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 21 Jan 2019 15:43:22 +0000 (16:43 +0100)]
Report: Compare NICs tables
- Change logging level from warning to debug.
Change-Id: I644bdf3a5d13a45a7835c8181ca95d63ff762233
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 21 Jan 2019 14:45:34 +0000 (15:45 +0100)]
Report: Reset the Report History to the initial version
Change-Id: I9bf1647de0b4f42c5ef0e80cf3b5dc2e968cc605
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 21 Jan 2019 12:02:31 +0000 (13:02 +0100)]
CSIT-1406: Configure PAL to generate 1901 Report
Change-Id: I2faf542970d9be54945a2f9fdaf0577bdfbd6d24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 15 Jan 2019 10:55:43 +0000 (11:55 +0100)]
CSIT-1397: Create Heatmap graphs
- Heatmap is used
Change-Id: I33a8619ea4a346bde92d85da0bbb63f3d916cbc5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 14 Jan 2019 12:31:45 +0000 (13:31 +0100)]
Bar graph for Soak tests results
CSIT-1401: Create bar graph for Soak tests results
CSIT-1405: Add data pre-processing for "soak tests" graphs
Change-Id: I158c54e713cb904eb1780190153413929c7bab6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 18 Jan 2019 12:19:01 +0000 (13:19 +0100)]
CSIT-1395: Create comparison tables for NICs
Change-Id: Ib8583041a0d16a6242160b4f51eae973ef33504f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 21 Jan 2019 08:33:09 +0000 (09:33 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.04-rc0~
21-g36eb7c2~b6151
- use new vpp ref build - centos7:
19.04-rc0~21_g36eb7c2~b5964
- use new vpp ref build - ubuntu 18.04:
19.04-rc0~
21-g36eb7c21~b1904
Change-Id: I8039c24dba66b46239d971d6184477a077fc0fcc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Mon, 14 Jan 2019 15:39:15 +0000 (15:39 +0000)]
CSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd.
Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 17 Jan 2019 18:16:10 +0000 (18:16 +0000)]
FIX SRv6 container tests after refactor
Change-Id: I6b7961c9103587b752c6ffc2a56eb98ed1529edb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 17 Jan 2019 18:32:39 +0000 (18:32 +0000)]
Increase default number of hugepages to allow full box testing
Change-Id: I1dc6f54e8371992e8c4a323bbad557e6c1fa435b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Peter Mikus [Thu, 17 Jan 2019 17:42:30 +0000 (17:42 +0000)]
Update csit-sut-dcr
Change-Id: I79907a92c658f1a53c49272b65ea29a5162e5e6a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Michal Cmarada [Tue, 15 Jan 2019 10:08:34 +0000 (11:08 +0100)]
fix failing tests after namespace updates in HC
Change-Id: Idf7cbcf285ff130f771eb3878065e6daa869ac71
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
Jan Gelety [Mon, 14 Jan 2019 07:53:45 +0000 (08:53 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.01-rc0~
634-gb5e55a2~b6114
- use new vpp ref build - centos7:
19.01-rc0~634_gb5e55a2~b5929
- use new vpp ref build - ubuntu 18.04:
19.01-rc0~
634-gb5e55a27~b1870
Change-Id: I50dd39ec37e1a005c5b15a81219a879a428e9dfe
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 14 Jan 2019 15:10:52 +0000 (16:10 +0100)]
CSIT-1402: Add VICs to trending
Change-Id: Ia854d9888130cf7b3df81644bc953e5524976dbc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 14 Jan 2019 08:04:40 +0000 (09:04 +0100)]
CSIT-1400: Prepare and publish 1810.03 Report
Change-Id: I63d989921e6dd2604adfbb93dc95a6de95c2f25d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 10 Jan 2019 12:14:48 +0000 (13:14 +0100)]
CSIT-1393: Check and correct all existing graphs in the Report
Change-Id: Ie6a63c91dfa7d0a7c688062b3a16663d84fcadc9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Thu, 10 Jan 2019 12:07:26 +0000 (12:07 +0000)]
Markdown doc with FD.io CSIT physical lab design for Hsw.
Change-Id: Icf3eabe120a7d3c8ba93b347fca20c05fc360f5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Maciek Konstantynowicz [Wed, 9 Jan 2019 14:50:35 +0000 (14:50 +0000)]
Markdown doc with FD.io CSIT physical lab design for Skx, Arm, Atom.
Change-Id: Ib93c3320d213e74f67984c90a0e30bd7b2d63181
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Peter Mikus [Wed, 2 Jan 2019 08:22:12 +0000 (08:22 +0000)]
Improve host-setup ansible scripts
Change-Id: I5b44be94e6c4ce5e19797d590cbd7f5de82698d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Thu, 10 Jan 2019 13:21:25 +0000 (14:21 +0100)]
CSIT-1394: Modify existing comparison tables
Change-Id: I3096bb2faeb61dc5715334cf19fe0e532fe4c68e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Michal Cmarada [Thu, 10 Jan 2019 08:22:36 +0000 (09:22 +0100)]
CSIT-1362: migrate to package cloud for HC performance tests
Change-Id: I43f62ea97e432504eb4ece85744d7fd6ff426113
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
Jan Gelety [Thu, 6 Dec 2018 12:23:05 +0000 (13:23 +0100)]
VPP_Device - add baseline tests - part IIa)
CSIT-1372
Add following baseline tests to VPP_Device:
- ip4
eth2p-ethip4-ip4base-eth-2vhost-1vm-dev
- ip6
eth2p-ethip6-ip6base-eth-2vhost-1vm-dev
- l2bd
eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev
- l2xc
eth2p-eth-l2xcbase-eth-2vhost-1vm-dev
+ fix doc strings in all vpp_device tests
Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Peter Mikus [Wed, 9 Jan 2019 13:15:09 +0000 (13:15 +0000)]
CSIT-1389 Refactor current keywords for multichaining - CNF (II)
Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Michal Cmarada [Wed, 9 Jan 2019 11:58:39 +0000 (12:58 +0100)]
fix permissions for dut_setup.sh
Change-Id: Ia11125e889a981a762c54281375a4e78159d8c69
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
Michal Cmarada [Tue, 8 Jan 2019 14:01:10 +0000 (15:01 +0100)]
performance tests update
Change-Id: If199757123974cf0889c2284ffc5c37ea9b18e7c
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
Peter Mikus [Tue, 8 Jan 2019 08:25:55 +0000 (08:25 +0000)]
CSIT-1389 Refactor current keywords for multichaining - CNF
- Add ability to create matrix of containers (chains x nodeness)
- Change default Docker image to csit-dut
- Use new resource mapping function
Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Yulong Pei [Sat, 5 Jan 2019 15:12:59 +0000 (23:12 +0800)]
[V4] Add sending unidirectional traffic support for TG in CSIT
Extend TG in CSIT to support to send unidirectional traffic, and then
it can be used by unidirectional test cases e.g. Load balancer.
Change-Id: Ie25bcdf7d4525a6d88d8ecd11a1b6d98275fa4d6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Peter Mikus [Fri, 4 Jan 2019 07:38:16 +0000 (07:38 +0000)]
CSIT-1387 Implement mapping function
Implement universal mapping function for placing the NF
threads to cpu cores/threads.
- Must be SMT aware.
- Must work with N-core NF.
- Must be DUT (vswtich) aware.
- Must be deterministic.
- Must use DTCR and MTCR parameters.
Change-Id: I98b61861f85c5af7ecd856719b4adf2ba95c262f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Mon, 7 Jan 2019 08:56:41 +0000 (09:56 +0100)]
Trending: Add latest changes to the "new" dir
Change-Id: Ib5d1c9561c5d21f2d72b5c1b643c114f37bacd1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Fri, 4 Jan 2019 10:59:15 +0000 (10:59 +0000)]
Updated trending methodology doc.
Change-Id: Iecb4c0799ae9c156e054d209e5eaba5972a3f556
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Jan Gelety [Mon, 7 Jan 2019 07:58:27 +0000 (08:58 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.01-rc0~
597-g03afb6d~b6077
- use new vpp ref build - centos7:
19.01-rc0~597_g03afb6d~b5892
Change-Id: I50a4fd324370f8dd9f17273e3f1ed8d4b36acd43
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Fri, 4 Jan 2019 14:52:20 +0000 (15:52 +0100)]
Adding pip requirements
- add pexpect - needed for vpp_device vhost tests
- add dill, numpy, scipy - needed for PLRSearch
Change-Id: Ib53f19e954f440773103b7913603a0c86ed81039
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Thu, 3 Jan 2019 09:30:30 +0000 (10:30 +0100)]
Trending: Remove unneeded tests from Dashboard
Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 2 Jan 2019 13:34:06 +0000 (13:34 +0000)]
CSIT-1382 Create weekly/semiweekly job for vpp-device
- Update gather function
Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Thu, 3 Jan 2019 09:00:46 +0000 (10:00 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.01-rc0~
580-g22af447~b6060
- use new vpp ref build - centos7:
19.01-rc0~580_g22af447~b5875
Change-Id: I939224ad47d684b7ab5f19198086f537e0699a32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Wed, 2 Jan 2019 08:49:01 +0000 (09:49 +0100)]
Trending: Align the content of old and new dirs
Change-Id: I39d1f71adac0bad3dbe18a987909904ea5c1e6cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 9 Oct 2018 09:36:47 +0000 (09:36 +0000)]
VHOST vectors.
Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Jan Gelety [Wed, 19 Dec 2018 12:33:07 +0000 (13:33 +0100)]
FIX: Avoid duplicated KW names in perf and func tests
Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 19 Dec 2018 08:33:49 +0000 (09:33 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.01-rc0~
501-gbef3619~b5981
- use new vpp ref build - centos7:
19.01-rc0~501_gbef3619~b5796
Change-Id: Idb9468bc1c328952b7c60f22be26f04b8d473781
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 18 Dec 2018 09:28:37 +0000 (10:28 +0100)]
FIX: do not use dump stats in IPv6 base tests
Change-Id: I9983b4aa1d6575f017bdfd69b6ab3b26206d9605
Signed-off-by: Jan Gelety <jgelety@cisco.com>
sharath [Fri, 26 Oct 2018 06:21:45 +0000 (11:51 +0530)]
Adding DMM build artifacts
Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
Jan Gelety [Mon, 17 Dec 2018 08:56:43 +0000 (09:56 +0100)]
FIX: Update PAPI to work with string changes in Python API
Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Fri, 14 Dec 2018 10:07:59 +0000 (11:07 +0100)]
Trending: Reduce input data
Change-Id: Ic49d52b924cbb468ed32fc8561a1101168b15614
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 12 Dec 2018 11:55:43 +0000 (12:55 +0100)]
CSIT-1377: Implement systematic solution using defined time period
Change-Id: I03d8a5fcf9e6392e238e04a06c0463c17b5a4a47
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 10 Dec 2018 11:35:21 +0000 (12:35 +0100)]
Trending: New sensitive detection
This enables PAL to consider burst size and stdev
when detecting anomalies.
Currently added as a separate presentation_new directory,
so the previous detection is still available by default.
TODO: If the state with two detections persists for some time,
create a script for generating presentation_new/
(from presentation/) to simplify maintenance.
Change-Id: Ic118aaf5ff036bf244c5820c86fa3766547fa938
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Jan Gelety [Thu, 13 Dec 2018 07:51:45 +0000 (08:51 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.01-rc0~
457-g11312ef~b5933
- use new vpp ref build - centos7:
19.01-rc0~457_g11312ef~b5746
Change-Id: Ie15c5bdfb433c2320a833f4c5d272c65d4cb1491
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Fri, 30 Nov 2018 12:31:32 +0000 (13:31 +0100)]
Delete old NDR/PDR keywords
Change-Id: I932d46646408a030ffdeb78b3a3e19c39455750d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 10 Dec 2018 15:09:12 +0000 (16:09 +0100)]
Add missing = to all suite Variables
Use the following if we ever decide '} =' is better than '}='.
$ cd csit/tests
$ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g'
FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450
Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 10 Dec 2018 12:21:47 +0000 (13:21 +0100)]
Reduce the input data for trending
Change-Id: I88ecdcf2ae4229318ea4b4f775d85597aef531c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 3 Dec 2018 08:08:09 +0000 (09:08 +0100)]
VPP_Device - add baseline tests - part I
CSIT-1370
Add following baseline tests to VPP_Device:
- ip4
eth2p-ethip4-ip4base-dev
- ip6
eth2p-ethip6-ip6base-dev
- l2bd
eth2p-eth-l2bdbasemaclrn-dev
Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Wed, 7 Nov 2018 15:02:15 +0000 (16:02 +0100)]
Report: we use IMIX also for ip6
Change-Id: Ic3aa4325357186bc9c23a9fbe4f8ac4278ddbea9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Fri, 30 Nov 2018 10:29:40 +0000 (11:29 +0100)]
CSIT-1374: Split the files with graphs int he Report
- Packet Latency
- Throughput Speedup Analysis
- Packet Throughput
Change-Id: If0df9fe8940eae08734f95c5150e10f2317c4927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 3 Dec 2018 13:09:58 +0000 (14:09 +0100)]
Change the Report version to .49
Change-Id: I14a371bcfb043ccb0a5cffc48f6f6f18d61f1942
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Mon, 3 Dec 2018 08:35:07 +0000 (09:35 +0100)]
Update of VPP_STABLE_VER
- use new vpp ref build - ubuntu 16.04:
19.01-rc0~
394-g6b4a32d~b5870
- use new vpp ref build - centos7:
19.01-rc0~394_g6b4a32d~b5683
Change-Id: Idf497fc7348bb8e6987025d8b56488b7282f5cda
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Tibor Frank [Mon, 3 Dec 2018 07:19:58 +0000 (08:19 +0100)]
Fix: CSIT-1299: Revise the graphs in Trending
- Graph: l2-feature-1t1c-x520-3n-hsw-oacl
Change-Id: Id724d98adc2b5bc5c1779df8b903215e8cf507f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 28 Nov 2018 15:15:02 +0000 (16:15 +0100)]
CSIT-1299: Revise the graphs in Trending
Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Wed, 28 Nov 2018 12:08:06 +0000 (13:08 +0100)]
FIX: VPP_Device - use vpp bionic packages
Because there is already used ubuntu bionic on VPP device testbed
and used download script from pacakgecloud site donwloads packages
based on host OS we need additional file to store vpp bionic stable
version for VPP_Device tests.
Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Wed, 28 Nov 2018 08:58:02 +0000 (09:58 +0100)]
FIX: Exclude softwire func tests from execution
CSIT-1371
Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/.
Excluding softwire functional tests from execution until corresponding csit KWs are fixed.
Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 19 Nov 2018 17:05:15 +0000 (18:05 +0100)]
Add trial duration info to tag documentation
Change-Id: Iad77972ab6a3f4eb4c2e3c09aebfcce0fc5f999b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 28 Nov 2018 08:49:40 +0000 (09:49 +0100)]
CSIT-1340: Fix the list of failed tests in Trending
Change-Id: I7c4adeb96d893f4d6d50f0fafcb5e908f57d478a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 28 Nov 2018 10:28:04 +0000 (11:28 +0100)]
Report versioning
Change-Id: I988f85c5c7dc13da0b71ba1831dfc4fc336f482a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 27 Nov 2018 12:40:30 +0000 (13:40 +0100)]
CSIT-1340: Fix the list of failed tests in Trending
Change-Id: I15f88c3f23f2c886367b54147cdf94155ca5e634
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 28 Nov 2018 07:19:31 +0000 (08:19 +0100)]
Report: Set precise NIC limit for x553
Change-Id: I183471013b06e67100637da589031672fd830a74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 28 Nov 2018 07:06:15 +0000 (08:06 +0100)]
Report: Set NIC limit for x553
Change-Id: Ibe85ed844501504085065631b393d2746227ea72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 28 Nov 2018 06:39:19 +0000 (07:39 +0100)]
CSIT-1351: Add Denverton results to report
Change-Id: Ic42dff93304baccb099beac08fc754fc48fa9cb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Jan Gelety [Tue, 25 Sep 2018 13:41:10 +0000 (15:41 +0200)]
CSIT python API introduction
Jira: CSIT-1336
Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Jan Gelety [Tue, 9 Oct 2018 07:38:51 +0000 (09:38 +0200)]
HLD: Python API in CSIT
Jira: CSIT-1335
Change-Id: Ifeebc6dad1e217e24455c4e627af740013429b56
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Vratko Polak [Mon, 26 Nov 2018 15:53:02 +0000 (16:53 +0100)]
Report: Fix two minor whitespace errors
Change-Id: Ib2bd38e1b8735b13ed24e9f190166fe5692a13de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 27 Nov 2018 13:00:07 +0000 (14:00 +0100)]
Report: Report Revisions
Change-Id: I30ab711834bba97c0b79f0c7f1f6ed556ab97f15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Nov 2018 15:01:13 +0000 (16:01 +0100)]
Report: versioning
Change-Id: I890d52b4b5b87cd1b3952b3d4bb3cbbff069a9c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Nov 2018 12:03:36 +0000 (13:03 +0100)]
CSIT-1351: Add Denverton results to report
- add graphs
Change-Id: I8220bfe61715916e915ae7adc37f36adcb4af8d2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Fri, 23 Nov 2018 19:14:18 +0000 (19:14 +0000)]
CSIT-1351: Add Denverton results to report
Change-Id: Id98822de2609e5a18a81d6b7b4b44d5a1652a592
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Code Review / csit.git / log