csit.git
5 years agoUpdated RF tag documentation file with svc density tags, other minor edits. 12/17012/3
Maciek Konstantynowicz [Wed, 23 Jan 2019 12:52:09 +0000 (12:52 +0000)]
Updated RF tag documentation file with svc density tags, other minor edits.

Change-Id: Iece74d5e7e380db344005a6035252bbe18925646
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: fix specification file 10/17010/1
Tibor Frank [Wed, 23 Jan 2019 12:28:03 +0000 (13:28 +0100)]
Report: fix specification file

Change-Id: Iae93d648b8d146ee363f5dbb3514edd90c74460a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoNF density: added new TAGs, renamed test suites and test cases per final agreed scheme. 74/16974/3
Maciek Konstantynowicz [Tue, 22 Jan 2019 13:46:51 +0000 (13:46 +0000)]
NF density: added new TAGs, renamed test suites and test cases per final agreed scheme.

Change-Id: Ia7bbfe5f7027c18a68408cc71445a2839b6b19a8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoReport: Add CSC and VSC data 00/17000/2
Tibor Frank [Wed, 23 Jan 2019 08:49:39 +0000 (09:49 +0100)]
Report: Add CSC and VSC data

Change-Id: Ia2ebe3d0b96d0012361082d1f45b5c3853db3640
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoVPP_Device - add baseline tests - part IIb) 11/16811/35
Jan Gelety [Thu, 10 Jan 2019 10:53:58 +0000 (11:53 +0100)]
VPP_Device - add baseline tests - part IIb)

CSIT-1372

Add following baseline tests to VPP_Device:
- ip4
  eth2p-ethip4-ip4base-eth-2memif-1dcr-dev

- ip6
  eth2p-ethip6-ip6base-eth-2memif-1dcr-dev

- l2bd
  eth2p-eth-l2bdbasemaclrn-eth-2memif-1dcr-dev

- l2xc
  eth2p-eth-l2xcbase-eth-2memif-1dcr-dev

Change-Id: Ic4a3a01b62d800c528a9c9371891dcc26b875220
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1404: Add data pre-processing for "service density" graphs 65/16965/1
Tibor Frank [Tue, 22 Jan 2019 12:04:01 +0000 (13:04 +0100)]
CSIT-1404: Add data pre-processing for "service density" graphs

Change-Id: If9c1a9ee3cf21640e2153b52693903c29791c7ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1404: Add data pre-processing for "service density" graphs 60/16960/11
Tibor Frank [Tue, 22 Jan 2019 10:24:01 +0000 (11:24 +0100)]
CSIT-1404: Add data pre-processing for "service density" graphs

Change-Id: Icd5709cd627999bc3ecc101abffb2ace3afdb246
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Compare NICs tables 40/16940/1
Tibor Frank [Mon, 21 Jan 2019 15:43:22 +0000 (16:43 +0100)]
Report: Compare NICs tables

 - Change logging level from warning to debug.

Change-Id: I644bdf3a5d13a45a7835c8181ca95d63ff762233
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Reset the Report History to the initial version 30/16930/1
Tibor Frank [Mon, 21 Jan 2019 14:45:34 +0000 (15:45 +0100)]
Report: Reset the Report History to the initial version

Change-Id: I9bf1647de0b4f42c5ef0e80cf3b5dc2e968cc605
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1406: Configure PAL to generate 1901 Report 23/16923/2
Tibor Frank [Mon, 21 Jan 2019 12:02:31 +0000 (13:02 +0100)]
CSIT-1406: Configure PAL to generate 1901 Report

Change-Id: I2faf542970d9be54945a2f9fdaf0577bdfbd6d24
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1397: Create Heatmap graphs 24/16824/63
Tibor Frank [Tue, 15 Jan 2019 10:55:43 +0000 (11:55 +0100)]
CSIT-1397: Create Heatmap graphs

 - Heatmap is used

Change-Id: I33a8619ea4a346bde92d85da0bbb63f3d916cbc5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoBar graph for Soak tests results 07/16807/21
Tibor Frank [Mon, 14 Jan 2019 12:31:45 +0000 (13:31 +0100)]
Bar graph for Soak tests results

CSIT-1401: Create bar graph for Soak tests results
CSIT-1405: Add data pre-processing for "soak tests" graphs

Change-Id: I158c54e713cb904eb1780190153413929c7bab6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1395: Create comparison tables for NICs 71/16871/11
Tibor Frank [Fri, 18 Jan 2019 12:19:01 +0000 (13:19 +0100)]
CSIT-1395: Create comparison tables for NICs

Change-Id: Ib8583041a0d16a6242160b4f51eae973ef33504f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 21/16921/1
Jan Gelety [Mon, 21 Jan 2019 08:33:09 +0000 (09:33 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.04-rc0~21-g36eb7c2~b6151

- use new vpp ref build - centos7:
  19.04-rc0~21_g36eb7c2~b5964

- use new vpp ref build - ubuntu 18.04:
  19.04-rc0~21-g36eb7c21~b1904

Change-Id: I8039c24dba66b46239d971d6184477a077fc0fcc
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd. 12/16812/15
Peter Mikus [Mon, 14 Jan 2019 15:39:15 +0000 (15:39 +0000)]
CSIT-1390 Implement multichain configuration for l2bd with vhost/l3fwd.

Change-Id: I36ab0bc7c9eada4c3f7bb5cb8f53de7d267ff910
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX SRv6 container tests after refactor 62/16862/3
Peter Mikus [Thu, 17 Jan 2019 18:16:10 +0000 (18:16 +0000)]
FIX SRv6 container tests after refactor

Change-Id: I6b7961c9103587b752c6ffc2a56eb98ed1529edb
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoIncrease default number of hugepages to allow full box testing 63/16863/1
Peter Mikus [Thu, 17 Jan 2019 18:32:39 +0000 (18:32 +0000)]
Increase default number of hugepages to allow full box testing

Change-Id: I1dc6f54e8371992e8c4a323bbad557e6c1fa435b
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate csit-sut-dcr 60/16860/1
Peter Mikus [Thu, 17 Jan 2019 17:42:30 +0000 (17:42 +0000)]
Update csit-sut-dcr

Change-Id: I79907a92c658f1a53c49272b65ea29a5162e5e6a
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agofix failing tests after namespace updates in HC 08/16808/3
Michal Cmarada [Tue, 15 Jan 2019 10:08:34 +0000 (11:08 +0100)]
fix failing tests after namespace updates in HC

Change-Id: Idf7cbcf285ff130f771eb3878065e6daa869ac71
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 02/16802/2
Jan Gelety [Mon, 14 Jan 2019 07:53:45 +0000 (08:53 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~634-gb5e55a2~b6114

- use new vpp ref build - centos7:
  19.01-rc0~634_gb5e55a2~b5929

- use new vpp ref build - ubuntu 18.04:
  19.01-rc0~634-gb5e55a27~b1870

Change-Id: I50dd39ec37e1a005c5b15a81219a879a428e9dfe
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1402: Add VICs to trending 10/16810/1
Tibor Frank [Mon, 14 Jan 2019 15:10:52 +0000 (16:10 +0100)]
CSIT-1402: Add VICs to trending

Change-Id: Ia854d9888130cf7b3df81644bc953e5524976dbc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1400: Prepare and publish 1810.03 Report 03/16803/1
Tibor Frank [Mon, 14 Jan 2019 08:04:40 +0000 (09:04 +0100)]
CSIT-1400: Prepare and publish 1810.03 Report

Change-Id: I63d989921e6dd2604adfbb93dc95a6de95c2f25d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1393: Check and correct all existing graphs in the Report 51/16751/5
Tibor Frank [Thu, 10 Jan 2019 12:14:48 +0000 (13:14 +0100)]
CSIT-1393: Check and correct all existing graphs in the Report

Change-Id: Ie6a63c91dfa7d0a7c688062b3a16663d84fcadc9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoMarkdown doc with FD.io CSIT physical lab design for Hsw. 50/16750/2
Maciek Konstantynowicz [Thu, 10 Jan 2019 12:07:26 +0000 (12:07 +0000)]
Markdown doc with FD.io CSIT physical lab design for Hsw.

Change-Id: Icf3eabe120a7d3c8ba93b347fca20c05fc360f5e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoMarkdown doc with FD.io CSIT physical lab design for Skx, Arm, Atom. 41/16741/4
Maciek Konstantynowicz [Wed, 9 Jan 2019 14:50:35 +0000 (14:50 +0000)]
Markdown doc with FD.io CSIT physical lab design for Skx, Arm, Atom.

Change-Id: Ib93c3320d213e74f67984c90a0e30bd7b2d63181
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoImprove host-setup ansible scripts 58/16658/2
Peter Mikus [Wed, 2 Jan 2019 08:22:12 +0000 (08:22 +0000)]
Improve host-setup ansible scripts

Change-Id: I5b44be94e6c4ce5e19797d590cbd7f5de82698d5
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoCSIT-1394: Modify existing comparison tables 52/16752/2
Tibor Frank [Thu, 10 Jan 2019 13:21:25 +0000 (14:21 +0100)]
CSIT-1394: Modify existing comparison tables

Change-Id: I3096bb2faeb61dc5715334cf19fe0e532fe4c68e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1362: migrate to package cloud for HC performance tests 47/16747/2
Michal Cmarada [Thu, 10 Jan 2019 08:22:36 +0000 (09:22 +0100)]
CSIT-1362: migrate to package cloud for HC performance tests

Change-Id: I43f62ea97e432504eb4ece85744d7fd6ff426113
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoVPP_Device - add baseline tests - part IIa) 72/16372/25
Jan Gelety [Thu, 6 Dec 2018 12:23:05 +0000 (13:23 +0100)]
VPP_Device - add baseline tests - part IIa)

CSIT-1372

Add following baseline tests to VPP_Device:
- ip4
  eth2p-ethip4-ip4base-eth-2vhost-1vm-dev

- ip6
  eth2p-ethip6-ip6base-eth-2vhost-1vm-dev

- l2bd
  eth2p-eth-l2bdbasemaclrn-eth-2vhost-1vm-dev

- l2xc
  eth2p-eth-l2xcbase-eth-2vhost-1vm-dev

+ fix doc strings in all vpp_device tests

Change-Id: Icc5ed801f3e8f6dedaa611779bd86fc20102fa74
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoCSIT-1389 Refactor current keywords for multichaining - CNF (II) 38/16738/4
Peter Mikus [Wed, 9 Jan 2019 13:15:09 +0000 (13:15 +0000)]
CSIT-1389 Refactor current keywords for multichaining - CNF (II)

Change-Id: Ic6af8ebf59589bea66322fc87a33218c7dc0c132
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agofix permissions for dut_setup.sh 36/16736/1
Michal Cmarada [Wed, 9 Jan 2019 11:58:39 +0000 (12:58 +0100)]
fix permissions for dut_setup.sh

Change-Id: Ia11125e889a981a762c54281375a4e78159d8c69
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoperformance tests update 27/16727/2
Michal Cmarada [Tue, 8 Jan 2019 14:01:10 +0000 (15:01 +0100)]
performance tests update

Change-Id: If199757123974cf0889c2284ffc5c37ea9b18e7c
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoCSIT-1389 Refactor current keywords for multichaining - CNF 25/16725/11
Peter Mikus [Tue, 8 Jan 2019 08:25:55 +0000 (08:25 +0000)]
CSIT-1389 Refactor current keywords for multichaining - CNF

- Add ability to create matrix of containers (chains x nodeness)
- Change default Docker image to csit-dut
- Use new resource mapping function

Change-Id: Iaac0f2efc99146fbaef0b33dc71b38770610023d
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years ago[V4] Add sending unidirectional traffic support for TG in CSIT 96/16696/3
Yulong Pei [Sat, 5 Jan 2019 15:12:59 +0000 (23:12 +0800)]
[V4] Add sending unidirectional traffic support for TG in CSIT

Extend TG in CSIT to support to send unidirectional traffic, and then
it can be used by unidirectional test cases e.g. Load balancer.

Change-Id: Ie25bcdf7d4525a6d88d8ecd11a1b6d98275fa4d6
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoCSIT-1387 Implement mapping function 85/16685/7
Peter Mikus [Fri, 4 Jan 2019 07:38:16 +0000 (07:38 +0000)]
CSIT-1387 Implement mapping function

Implement universal mapping function for placing the NF
threads to cpu cores/threads.

- Must be SMT aware.
- Must work with N-core NF.
- Must be DUT (vswtich) aware.
- Must be deterministic.
- Must use DTCR and MTCR parameters.

Change-Id: I98b61861f85c5af7ecd856719b4adf2ba95c262f
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoTrending: Add latest changes to the "new" dir 04/16704/2
Tibor Frank [Mon, 7 Jan 2019 08:56:41 +0000 (09:56 +0100)]
Trending: Add latest changes to the "new" dir

Change-Id: Ib5d1c9561c5d21f2d72b5c1b643c114f37bacd1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdated trending methodology doc. 88/16688/4
Maciek Konstantynowicz [Fri, 4 Jan 2019 10:59:15 +0000 (10:59 +0000)]
Updated trending methodology doc.

Change-Id: Iecb4c0799ae9c156e054d209e5eaba5972a3f556
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 03/16703/1
Jan Gelety [Mon, 7 Jan 2019 07:58:27 +0000 (08:58 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~597-g03afb6d~b6077

- use new vpp ref build - centos7:
  19.01-rc0~597_g03afb6d~b5892

Change-Id: I50a4fd324370f8dd9f17273e3f1ed8d4b36acd43
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdding pip requirements 90/16690/3
Jan Gelety [Fri, 4 Jan 2019 14:52:20 +0000 (15:52 +0100)]
Adding pip requirements

- add pexpect - needed for vpp_device vhost tests
- add dill, numpy, scipy - needed for PLRSearch

Change-Id: Ib53f19e954f440773103b7913603a0c86ed81039
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: Remove unneeded tests from Dashboard 79/16679/21
Tibor Frank [Thu, 3 Jan 2019 09:30:30 +0000 (10:30 +0100)]
Trending: Remove unneeded tests from Dashboard

Change-Id: I0f57735bcc578b42994721ca88dc1bb60af475de
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1382 Create weekly/semiweekly job for vpp-device 63/16663/6
Peter Mikus [Wed, 2 Jan 2019 13:34:06 +0000 (13:34 +0000)]
CSIT-1382 Create weekly/semiweekly job for vpp-device

- Update gather function

Change-Id: If130b93fd8c9752bb804a8ecc53c1598e8669031
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 77/16677/1
Jan Gelety [Thu, 3 Jan 2019 09:00:46 +0000 (10:00 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~580-g22af447~b6060

- use new vpp ref build - centos7:
  19.01-rc0~580_g22af447~b5875

Change-Id: I939224ad47d684b7ab5f19198086f537e0699a32
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: Align the content of old and new dirs 59/16659/3
Tibor Frank [Wed, 2 Jan 2019 08:49:01 +0000 (09:49 +0100)]
Trending: Align the content of old and new dirs

Change-Id: I39d1f71adac0bad3dbe18a987909904ea5c1e6cb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoVHOST vectors. 88/15188/9
Peter Mikus [Tue, 9 Oct 2018 09:36:47 +0000 (09:36 +0000)]
VHOST vectors.

Change-Id: I5e17c5ab5cb99af0ac3d063ffc911bf95457d3e4
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoFIX: Avoid duplicated KW names in perf and func tests 49/16549/2
Jan Gelety [Wed, 19 Dec 2018 12:33:07 +0000 (13:33 +0100)]
FIX: Avoid duplicated KW names in perf and func tests

Change-Id: I66c68edf6e26fa7baa7bdc5f5d60d4d4aa3af6b9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 38/16538/1
Jan Gelety [Wed, 19 Dec 2018 08:33:49 +0000 (09:33 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~501-gbef3619~b5981

- use new vpp ref build - centos7:
  19.01-rc0~501_gbef3619~b5796

Change-Id: Idb9468bc1c328952b7c60f22be26f04b8d473781
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: do not use dump stats in IPv6 base tests 24/16524/2
Jan Gelety [Tue, 18 Dec 2018 09:28:37 +0000 (10:28 +0100)]
FIX: do not use dump stats in IPv6 base tests

Change-Id: I9983b4aa1d6575f017bdfd69b6ab3b26206d9605
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdding DMM build artifacts 47/15547/7
sharath [Fri, 26 Oct 2018 06:21:45 +0000 (11:51 +0530)]
Adding DMM build artifacts

Change-Id: Ia5153d8e716d506c85ec8b723331438efd66ab6a
Signed-off-by: sharath <sharathkumarboyanapally@gmail.com>
5 years agoFIX: Update PAPI to work with string changes in Python API 07/16507/1
Jan Gelety [Mon, 17 Dec 2018 08:56:43 +0000 (09:56 +0100)]
FIX: Update PAPI to work with string changes in Python API

Change-Id: I3b5f0568b5928cf12aaf2a555f52dd9809348579
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoTrending: Reduce input data 75/16475/1
Tibor Frank [Fri, 14 Dec 2018 10:07:59 +0000 (11:07 +0100)]
Trending: Reduce input data

Change-Id: Ic49d52b924cbb468ed32fc8561a1101168b15614
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1377: Implement systematic solution using defined time period 42/16442/8
Tibor Frank [Wed, 12 Dec 2018 11:55:43 +0000 (12:55 +0100)]
CSIT-1377: Implement systematic solution using defined time period

Change-Id: I03d8a5fcf9e6392e238e04a06c0463c17b5a4a47
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoTrending: New sensitive detection 13/16413/4
Vratko Polak [Mon, 10 Dec 2018 11:35:21 +0000 (12:35 +0100)]
Trending: New sensitive detection

This enables PAL to consider burst size and stdev
when detecting anomalies.

Currently added as a separate presentation_new directory,
so the previous detection is still available by default.

TODO: If the state with two detections persists for some time,
create a script for generating presentation_new/
(from presentation/) to simplify maintenance.

Change-Id: Ic118aaf5ff036bf244c5820c86fa3766547fa938
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 56/16456/1
Jan Gelety [Thu, 13 Dec 2018 07:51:45 +0000 (08:51 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~457-g11312ef~b5933

- use new vpp ref build - centos7:
  19.01-rc0~457_g11312ef~b5746

Change-Id: Ie15c5bdfb433c2320a833f4c5d272c65d4cb1491
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoDelete old NDR/PDR keywords 98/16298/6
Vratko Polak [Fri, 30 Nov 2018 12:31:32 +0000 (13:31 +0100)]
Delete old NDR/PDR keywords

Change-Id: I932d46646408a030ffdeb78b3a3e19c39455750d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoAdd missing = to all suite Variables 23/16423/2
Vratko Polak [Mon, 10 Dec 2018 15:09:12 +0000 (16:09 +0100)]
Add missing = to all suite Variables

Use the following if we ever decide '} =' is better than '}='.
$ cd csit/tests
$ find . -type f -print0 | xargs -0 sed -i -E 's/^\| \$\{(.*)\}= \|([^|])/\| \$\{\1\} = \|\2/g'

FIXME: Add a corresponding check to https://gerrit.fd.io/r/13450

Change-Id: I73c516a0d7e475ff0986fd6515aaae10accd1a3a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReduce the input data for trending 16/16416/1
Tibor Frank [Mon, 10 Dec 2018 12:21:47 +0000 (13:21 +0100)]
Reduce the input data for trending

Change-Id: I88ecdcf2ae4229318ea4b4f775d85597aef531c2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoVPP_Device - add baseline tests - part I 22/16322/25
Jan Gelety [Mon, 3 Dec 2018 08:08:09 +0000 (09:08 +0100)]
VPP_Device - add baseline tests - part I

CSIT-1370

Add following baseline tests to VPP_Device:
- ip4
  eth2p-ethip4-ip4base-dev
- ip6
  eth2p-ethip6-ip6base-dev
- l2bd
  eth2p-eth-l2bdbasemaclrn-dev

Change-Id: Ic20000eb38c5511c27d020f3aa76b2620d7f7ef9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: we use IMIX also for ip6 04/15804/3
Vratko Polak [Wed, 7 Nov 2018 15:02:15 +0000 (16:02 +0100)]
Report: we use IMIX also for ip6

Change-Id: Ic3aa4325357186bc9c23a9fbe4f8ac4278ddbea9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1374: Split the files with graphs int he Report 97/16297/3
Tibor Frank [Fri, 30 Nov 2018 10:29:40 +0000 (11:29 +0100)]
CSIT-1374: Split the files with graphs int he Report

 - Packet Latency
 - Throughput Speedup Analysis
 - Packet Throughput

Change-Id: If0df9fe8940eae08734f95c5150e10f2317c4927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoChange the Report version to .49 24/16324/1
Tibor Frank [Mon, 3 Dec 2018 13:09:58 +0000 (14:09 +0100)]
Change the Report version to .49

Change-Id: I14a371bcfb043ccb0a5cffc48f6f6f18d61f1942
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 16/16316/2
Jan Gelety [Mon, 3 Dec 2018 08:35:07 +0000 (09:35 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~394-g6b4a32d~b5870

- use new vpp ref build - centos7:
  19.01-rc0~394_g6b4a32d~b5683

Change-Id: Idf497fc7348bb8e6987025d8b56488b7282f5cda
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFix: CSIT-1299: Revise the graphs in Trending 13/16313/1
Tibor Frank [Mon, 3 Dec 2018 07:19:58 +0000 (08:19 +0100)]
Fix: CSIT-1299: Revise the graphs in Trending

 - Graph: l2-feature-1t1c-x520-3n-hsw-oacl

Change-Id: Id724d98adc2b5bc5c1779df8b903215e8cf507f3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1299: Revise the graphs in Trending 56/16256/5
Tibor Frank [Wed, 28 Nov 2018 15:15:02 +0000 (16:15 +0100)]
CSIT-1299: Revise the graphs in Trending

Change-Id: Ie8cbc7bc8a58aca41c8cb35c14dbd8e80f027f5c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFIX: VPP_Device - use vpp bionic packages 50/16250/6
Jan Gelety [Wed, 28 Nov 2018 12:08:06 +0000 (13:08 +0100)]
FIX: VPP_Device - use vpp bionic packages

Because there is already used ubuntu bionic on VPP device testbed
and used download script from pacakgecloud site donwloads packages
based on host OS we need additional file to store vpp bionic stable
version for VPP_Device tests.

Change-Id: If834dc8af7dffa19b8ddeae013c3da9b37a5a81a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoFIX: Exclude softwire func tests from execution 44/16244/2
Jan Gelety [Wed, 28 Nov 2018 08:58:02 +0000 (09:58 +0100)]
FIX: Exclude softwire func tests from execution

CSIT-1371

Map commands were remove from VAT by patch https://gerrit.fd.io/r/#/c/16115/.
Excluding softwire functional tests from execution until corresponding csit KWs are fixed.

Change-Id: I2adc580fb4770746c355f12f5ce7e7f8823255d8
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoAdd trial duration info to tag documentation 38/16038/4
Vratko Polak [Mon, 19 Nov 2018 17:05:15 +0000 (18:05 +0100)]
Add trial duration info to tag documentation

Change-Id: Iad77972ab6a3f4eb4c2e3c09aebfcce0fc5f999b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoCSIT-1340: Fix the list of failed tests in Trending 42/16242/3
Tibor Frank [Wed, 28 Nov 2018 08:49:40 +0000 (09:49 +0100)]
CSIT-1340: Fix the list of failed tests in Trending

Change-Id: I7c4adeb96d893f4d6d50f0fafcb5e908f57d478a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport versioning 47/16247/1
Tibor Frank [Wed, 28 Nov 2018 10:28:04 +0000 (11:28 +0100)]
Report versioning

Change-Id: I988f85c5c7dc13da0b71ba1831dfc4fc336f482a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1340: Fix the list of failed tests in Trending 18/16218/2
Tibor Frank [Tue, 27 Nov 2018 12:40:30 +0000 (13:40 +0100)]
CSIT-1340: Fix the list of failed tests in Trending

Change-Id: I15f88c3f23f2c886367b54147cdf94155ca5e634
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Set precise NIC limit for x553 39/16239/1
Tibor Frank [Wed, 28 Nov 2018 07:19:31 +0000 (08:19 +0100)]
Report: Set precise NIC limit for x553

Change-Id: I183471013b06e67100637da589031672fd830a74
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Set NIC limit for x553 37/16237/1
Tibor Frank [Wed, 28 Nov 2018 07:06:15 +0000 (08:06 +0100)]
Report: Set NIC limit for x553

Change-Id: Ibe85ed844501504085065631b393d2746227ea72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 33/16233/2
Tibor Frank [Wed, 28 Nov 2018 06:39:19 +0000 (07:39 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: Ic42dff93304baccb099beac08fc754fc48fa9cb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT python API introduction 27/15727/27
Jan Gelety [Tue, 25 Sep 2018 13:41:10 +0000 (15:41 +0200)]
CSIT python API introduction

Jira: CSIT-1336

Change-Id: I96d2b0221c5a7466484a82339fc132c5921532d1
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoHLD: Python API in CSIT 91/15191/5
Jan Gelety [Tue, 9 Oct 2018 07:38:51 +0000 (09:38 +0200)]
HLD: Python API in CSIT

Jira: CSIT-1335

Change-Id: Ifeebc6dad1e217e24455c4e627af740013429b56
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Fix two minor whitespace errors 90/16190/2
Vratko Polak [Mon, 26 Nov 2018 15:53:02 +0000 (16:53 +0100)]
Report: Fix two minor whitespace errors

Change-Id: Ib2bd38e1b8735b13ed24e9f190166fe5692a13de
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoReport: Report Revisions 22/16222/4
Tibor Frank [Tue, 27 Nov 2018 13:00:07 +0000 (14:00 +0100)]
Report: Report Revisions

Change-Id: I30ab711834bba97c0b79f0c7f1f6ed556ab97f15
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: versioning 87/16187/6
Tibor Frank [Mon, 26 Nov 2018 15:01:13 +0000 (16:01 +0100)]
Report: versioning

Change-Id: I890d52b4b5b87cd1b3952b3d4bb3cbbff069a9c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 82/16182/4
Tibor Frank [Mon, 26 Nov 2018 12:03:36 +0000 (13:03 +0100)]
CSIT-1351: Add Denverton results to report

 - add graphs

Change-Id: I8220bfe61715916e915ae7adc37f36adcb4af8d2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 54/16154/2
Tibor Frank [Fri, 23 Nov 2018 19:14:18 +0000 (19:14 +0000)]
CSIT-1351: Add Denverton results to report

Change-Id: Id98822de2609e5a18a81d6b7b4b44d5a1652a592
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoAdding python-cffi requirements 25/15925/9
Peter Mikus [Wed, 14 Nov 2018 09:14:05 +0000 (09:14 +0000)]
Adding python-cffi requirements

- Introduce Ubuntu 18.04.5 VIRL image
- FIX mac addresses for dhcp
- Add ansible task for python-cffi install on perf testbeds

Change-Id: I8acfcdc8ee97c13ad4795a4ccde868a96b3fee47
Signed-off-by: Peter Mikus <pmikus@cisco.com>
5 years agoReport: Update version and document history 46/16146/1
Tibor Frank [Fri, 23 Nov 2018 13:49:09 +0000 (14:49 +0100)]
Report: Update version and document history

Change-Id: If562f112daa218ff40a7d8ccb5a144feb2c32760
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 44/16144/1
Tibor Frank [Fri, 23 Nov 2018 13:38:57 +0000 (14:38 +0100)]
CSIT-1351: Add Denverton results to report

 - Add tests' configurations
 - Add tests' operational data

Change-Id: Ie435beb5942a6525fe8f3ccbcfabd887ff98ff0a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoMove reservation directory to TG node. 20/16120/2
Vratko Polak [Fri, 23 Nov 2018 11:20:06 +0000 (12:20 +0100)]
Move reservation directory to TG node.

Testing has showed SSH access to DUT affects performance.
Downside: No support for non-Linux TGs.
Complication: After merge there might be conflicts with older jobs,
including jobs for other branches.

Change-Id: Icefddc5a9ca8f4d830460e53a82bb45231f7222e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 years agoTrending: Reduce the input data 31/16131/1
Tibor Frank [Fri, 23 Nov 2018 10:15:20 +0000 (11:15 +0100)]
Trending: Reduce the input data

Change-Id: I60172aeb24cacd58bd87ca585106d53b6dbad6a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Fix the labels 97/16097/1
Tibor Frank [Wed, 21 Nov 2018 13:59:34 +0000 (14:59 +0100)]
Report: Fix the labels

Change-Id: I82740007b4c12b8a21014b4572b034013f165280
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Disable archiving the report in Jenkins 95/16095/1
Tibor Frank [Wed, 21 Nov 2018 13:00:28 +0000 (14:00 +0100)]
Report: Disable archiving the report in Jenkins

 - The zipped Report is 7.3GB big, it takes 13 minutes to create the archive
   and 14 minutes to archive it. Nobody needs it.

Change-Id: Iffd72498b30b1aebc2d3b9be03f31d972a461d6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 91/16091/1
Tibor Frank [Wed, 21 Nov 2018 12:44:42 +0000 (13:44 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: I933220671cecd1ecceef6cc36a204fa8d7144508
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 86/16086/1
Tibor Frank [Wed, 21 Nov 2018 11:20:07 +0000 (12:20 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: I0a93ce903ee35098da4ebfd4dd3b2a479e12711b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agodoc: add calibration result and meltspec check result for Denverton 41/16041/4
Yulong Pei [Tue, 20 Nov 2018 14:23:10 +0000 (22:23 +0800)]
doc: add calibration result and meltspec check result for Denverton

Change-Id: I0094ba5ea59b18d6a7a9235cd153db393517cc02
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agodoc: add 2-node denverton section to physical testbeds 17/16017/4
Yulong Pei [Mon, 19 Nov 2018 16:51:58 +0000 (00:51 +0800)]
doc: add 2-node denverton section to physical testbeds

Change-Id: I7e35622f8b6b8e1a76f0e1c8fe17f4c9c40937b4
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
5 years agoTrending: Reduce the input data 80/16080/1
Tibor Frank [Wed, 21 Nov 2018 09:56:37 +0000 (10:56 +0100)]
Trending: Reduce the input data

Change-Id: I8a4bb7bc9fa34ace12621e7ffd5acba2c8aa2d9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 75/16075/2
Tibor Frank [Wed, 21 Nov 2018 09:27:46 +0000 (10:27 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: I4c2ae4ca8ababcae07861ad253dd080b25f16279
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 68/16068/1
Tibor Frank [Wed, 21 Nov 2018 07:18:16 +0000 (08:18 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: Ic2362a4c9dceff45e40b43dad8f8161cb65a03f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 56/16056/1
Tibor Frank [Tue, 20 Nov 2018 14:36:25 +0000 (15:36 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: I713fc07aea6914dd554240e68231caf957b426a6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1351: Add Denverton results to report 50/16050/8
Tibor Frank [Tue, 20 Nov 2018 11:05:32 +0000 (12:05 +0100)]
CSIT-1351: Add Denverton results to report

Change-Id: I0e92c183fe972ce9fe8e7b3d3fca6e6bb86ddd54
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoCSIT-1359: Add 3n-skx and 2n-skx comparisons to Report 32/16032/4
Tibor Frank [Mon, 19 Nov 2018 13:56:32 +0000 (14:56 +0100)]
CSIT-1359: Add 3n-skx and 2n-skx comparisons to Report

 - 3n-Skx vs. 2n-Skx Testbeds

Change-Id: I63e1d34d4589bbb771961ed3c21f0271fee728ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoFix Acl Plugin tests after update of Acl models 31/16031/2
Michal Cmarada [Mon, 19 Nov 2018 13:41:31 +0000 (14:41 +0100)]
Fix Acl Plugin tests after update of Acl models

Change-Id: I8c4090b508e28ae8f289e9dbbd5c72bbc3af4aca
Signed-off-by: Michal Cmarada <mcmarada@cisco.com>
5 years agoUpdate of VPP_STABLE_VER 14/16014/2
Jan Gelety [Mon, 19 Nov 2018 08:07:33 +0000 (09:07 +0100)]
Update of VPP_STABLE_VER

- use new vpp ref build - ubuntu 16.04:
  19.01-rc0~256-ga7dcae7~b5735_amd64

Change-Id: I2d758dca16eda0bdf17c5289ac386af19c0693bb
Signed-off-by: Jan Gelety <jgelety@cisco.com>
5 years agoReport: Edit the chapters' titles 18/16018/6
Tibor Frank [Mon, 19 Nov 2018 10:18:34 +0000 (11:18 +0100)]
Report: Edit the chapters' titles

Change-Id: I23cedb3ad0f188e9c7570f549e397f4c42404fab
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 years agoReport: Change the title of Report history 15/16015/1
Tibor Frank [Mon, 19 Nov 2018 08:58:24 +0000 (09:58 +0100)]
Report: Change the title of Report history

Change-Id: Idda7feb2f3c11d7fbe7d872eb5b849878965a407
Signed-off-by: Tibor Frank <tifrank@cisco.com>