csit.git
3 years agoUpdate selection of report-iterative test sets 95/27495/1
Tibor Frank [Thu, 11 Jun 2020 10:17:41 +0000 (12:17 +0200)]
Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 93/27493/1
Tibor Frank [Thu, 11 Jun 2020 08:49:17 +0000 (10:49 +0200)]
Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, 2n-clx x533 cur vs prev tab 87/27487/1
Tibor Frank [Wed, 10 Jun 2020 13:51:55 +0000 (15:51 +0200)]
Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_coverage 75/27475/2
Maciek Konstantynowicz [Tue, 9 Jun 2020 15:51:42 +0000 (16:51 +0100)]
docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2005: Add data 82/27482/1
Tibor Frank [Wed, 10 Jun 2020 10:17:47 +0000 (12:17 +0200)]
Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoNAT44 EI tests 39/27339/16
Maros Mullner [Tue, 26 May 2020 06:11:49 +0000 (08:11 +0200)]
NAT44 EI tests

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ib5f58f60a1409ed139e2846793bf52fdc02a6571

3 years agoReport 2005: vpp-device static content 46/27446/2
Jan Gelety [Thu, 28 May 2020 20:50:12 +0000 (22:50 +0200)]
Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible speed up 78/27478/1
pmikus [Wed, 10 Jun 2020 08:05:37 +0000 (08:05 +0000)]
Infra: Ansible speed up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I24a22b1492593df937af2a17cd0c8684af7cd500

3 years agodocs: update 2n-dnv job_specs for report_coverage 50/27450/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:11:33 +0000 (13:11 +0100)]
docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-hsw job_specs for report_coverage 56/27456/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 18:24:34 +0000 (19:24 +0100)]
docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_coverage 49/27449/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 11:57:13 +0000 (12:57 +0100)]
docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-dnv job_specs for report_coverage 52/27452/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:53:25 +0000 (13:53 +0100)]
docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Ansible Nomad 61/27461/4
pmikus [Mon, 8 Jun 2020 06:43:19 +0000 (06:43 +0000)]
Infra: Ansible Nomad

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2560e3e12b457413db81a7ecc52efd7e39f1aea2

3 years agoRemove leading tc[nn] from test names 15/27215/4
Juraj Linkeš [Fri, 22 May 2020 12:25:24 +0000 (14:25 +0200)]
Remove leading tc[nn] from test names

The test names are unique without it and the information doesn't add
anything extra.

Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 70/27470/1
Tibor Frank [Tue, 9 Jun 2020 07:49:21 +0000 (09:49 +0200)]
Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, configure 2005.24 63/27463/1
Tibor Frank [Mon, 8 Jun 2020 10:14:09 +0000 (12:14 +0200)]
Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 20/27420/1
Tibor Frank [Thu, 4 Jun 2020 09:31:54 +0000 (11:31 +0200)]
Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 18/27418/1
Tibor Frank [Thu, 4 Jun 2020 08:17:52 +0000 (10:17 +0200)]
Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr 11/27411/1
Tibor Frank [Wed, 3 Jun 2020 13:56:08 +0000 (15:56 +0200)]
Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad 05/27405/2
pmikus [Wed, 3 Jun 2020 10:29:25 +0000 (10:29 +0000)]
Infra: Ansible Nomad

+ Prometheus Telemetry stanza
- ARM Softirons

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib7bf577ed0460ab5b79700ff0f8d52d5704cec59

3 years agoReport 2005: Fix wrong indentation in spec file 09/27409/1
Tibor Frank [Wed, 3 Jun 2020 12:59:13 +0000 (14:59 +0200)]
Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 08/27408/1
Tibor Frank [Wed, 3 Jun 2020 12:49:30 +0000 (14:49 +0200)]
Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: IP4 IP6 3n-only 06/27406/1
pmikus [Wed, 3 Jun 2020 10:52:37 +0000 (10:52 +0000)]
FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf

3 years agoFix DPDK build on arm 58/27358/4
Juraj Linkeš [Mon, 1 Jun 2020 08:40:52 +0000 (10:40 +0200)]
Fix DPDK build on arm

Directive #include <file> in GCC implementation searches for files
in a standard list of system directories, which leads to a build
error on Taishan arm machines:
/tmp/openvpp-testing/dpdk/lib/librte_ethdev/rte_ethdev.h:4287:10:
fatal error: rte_ethdev_core.h:
No such file or directory #include <rte_ethdev_core.h>

Fix this by replacing the directive with #include "file" which searches
for files first in the directory containing the current file and other
directories only after that.

Change-Id: If283b81c992c001a2f980312cdd99053c3d703d9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 99/27399/1
Tibor Frank [Tue, 2 Jun 2020 18:38:52 +0000 (20:38 +0200)]
Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 89/27389/1
Tibor Frank [Tue, 2 Jun 2020 11:18:10 +0000 (13:18 +0200)]
Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 85/27385/1
Tibor Frank [Tue, 2 Jun 2020 09:16:36 +0000 (11:16 +0200)]
Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 61/27361/2
Tibor Frank [Mon, 1 Jun 2020 11:56:46 +0000 (13:56 +0200)]
Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 60/27360/1
Jan Gelety [Wed, 27 May 2020 14:49:37 +0000 (16:49 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~84-g353535bb4

 - use new vpp ref build - centos7:
   20.09-rc0~84_g353535b~b9559

Change-Id: I6ae6565b18de498e494db29824f85701b3e37642
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 59/27359/1
Tibor Frank [Mon, 1 Jun 2020 10:12:41 +0000 (12:12 +0200)]
Report: Add data

Ticket: CSIT-1723
Type: data

Change-Id: Iae3abf0740160e96bcd3126af9a8be04abf22db3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible ARM 57/27357/2
pmikus [Mon, 1 Jun 2020 07:47:03 +0000 (07:47 +0000)]
Infra: Ansible ARM

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iffdb12cc7013a38341a09df2f863ee7c56196bb0

3 years agoReport 2005: Add data 56/27356/1
Tibor Frank [Mon, 1 Jun 2020 06:32:03 +0000 (08:32 +0200)]
Report 2005: Add data

Ticket: CSIT-1723
Type: data

Change-Id: I4459da5ab5648d68599e8405d230047a6f4be0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 2n-clx job_specs for report_coverage 95/27295/2
Maciek Konstantynowicz [Wed, 27 May 2020 18:34:45 +0000 (19:34 +0100)]
docs: update 2n-clx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I676062f8ca4c6457f09165310d770d1e18fa59e3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Add data and dpdk comparison tables 37/27337/2
Tibor Frank [Fri, 29 May 2020 09:01:13 +0000 (11:01 +0200)]
Report: Add data and dpdk comparison tables

+ data:
  + vpp-device
  + perf-sel-3n-hsw
  + dpdk-3n-hsw
  + dpdk-3n-skx
  + dpdk-2n-skx
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv

+ comparison tables current vs previous:
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv
  + dpdk-3n-tsh

Ticket: CSIT-1723
Type: data

Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: check if testpmd is alive 31/27331/1
Jan Gelety [Wed, 27 May 2020 01:55:11 +0000 (03:55 +0200)]
FIX: check if testpmd is alive

Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoRemove hugepage dirs when killing dpdk 98/27298/2
Juraj Linkeš [Thu, 28 May 2020 06:52:21 +0000 (08:52 +0200)]
Remove hugepage dirs when killing dpdk

There could be directories under /dev/hugepages/ so remove those as
well.

Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Fix links to html tables 23/27323/2
Tibor Frank [Thu, 28 May 2020 09:50:45 +0000 (11:50 +0200)]
Report: Fix links to html tables

Type: Fix

Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 22/27322/2
Jan Gelety [Tue, 26 May 2020 18:50:29 +0000 (20:50 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~70-g7f475bf4b

 - use new vpp ref build - centos7:
   20.09-rc0~70_g7f475bf~b9545

Change-Id: I39a665fcdda0659ce9228cc43aac28fcbfa3a987
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Improvements in tables and formatting 87/27287/4
Tibor Frank [Wed, 27 May 2020 10:57:58 +0000 (12:57 +0200)]
PAL: Improvements in tables and formatting

+ legend
+ footnote
+ output to log
+ fix formatting in the methodology section

Type: Improvements

Change-Id: I605615a602b239265fc6768a65c8d33dd793d4c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: do not fail when skipping patch for l3fwd 91/27291/1
Jan Gelety [Tue, 26 May 2020 13:10:07 +0000 (15:10 +0200)]
FIX: do not fail when skipping patch for l3fwd

Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoINFO: Add Juraj to committers 73/27273/3
Vratko Polak [Wed, 27 May 2020 14:26:12 +0000 (16:26 +0200)]
INFO: Add Juraj to committers

Change-Id: I5739a11dbe921291ea4aa0ee104556590fbe5228
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoTerraform and ansible changes for Cloud environment (AWS, Azure). 10/27210/4
Maros Mullner [Fri, 22 May 2020 06:27:07 +0000 (08:27 +0200)]
Terraform and ansible changes for Cloud environment (AWS, Azure).

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ic78b5dae22b67763b99c50a5f15d7dd16152d5d5

3 years agoPAL: Fix table_comparison again 85/27285/1
Tibor Frank [Wed, 27 May 2020 08:57:46 +0000 (10:57 +0200)]
PAL: Fix table_comparison again

Change-Id: Ie408afd7bb8390ebe2fc90eca6daf8da44d22e3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Fix table_comparison 83/27283/1
Tibor Frank [Wed, 27 May 2020 08:18:24 +0000 (10:18 +0200)]
PAL: Fix table_comparison

Type: Fix

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I532cdb0967708e48bc9f9c5e87f96f95acbb9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: configure report rls2005 72/27272/3
Tibor Frank [Tue, 26 May 2020 13:52:55 +0000 (15:52 +0200)]
Report: configure report rls2005

Ticket: CSIT-1722
Type: feature

Change-Id: I76f7f323f000cbfc802c6206b6232665bb88448c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: add dpdk mrr_weekly and report_iterative job specs 32/27232/2
Jan Gelety [Mon, 25 May 2020 15:50:28 +0000 (17:50 +0200)]
FIX: add dpdk mrr_weekly and report_iterative job specs

- split job specs to directories

Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd csit-vpp/dpdk-perf-report-coverage job and job specifications 24/27124/7
Jan Gelety [Fri, 8 May 2020 10:38:01 +0000 (12:38 +0200)]
Add csit-vpp/dpdk-perf-report-coverage job and job specifications

- note: currently dpdk report-coverge test sets are equal to dpdk
  report-iterative test sets

Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: vts perf tests 40/27240/2
Jan Gelety [Mon, 25 May 2020 20:50:00 +0000 (22:50 +0200)]
FIX: vts perf tests

Change-Id: Ie144c22575a7976da0c77e787e450355b73b0006
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible Nomad IV 31/27231/2
pmikus [Mon, 25 May 2020 15:44:18 +0000 (15:44 +0000)]
Infra: Ansible Nomad IV

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I67ab84c2c2b34ce5ccc3a2de629c41460bb52e8c

3 years agoReport: Infra update 82/26882/15
pmikus [Tue, 5 May 2020 12:30:44 +0000 (12:30 +0000)]
Report: Infra update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie39585e88460d9a5e3764726d93dc065f5cbacfb

3 years agoUpdate of VPP_STABLE_VER files 29/27229/2
Jan Gelety [Mon, 25 May 2020 07:38:09 +0000 (09:38 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~45-gcbe053e14

 - use new vpp ref build - centos7:
   20.09-rc0~45_gcbe053e~b9520

Change-Id: I944e1344df05c4a6fbfe6079d0203a78a20e16c9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible Nomad III 20/27220/3
pmikus [Fri, 22 May 2020 15:55:40 +0000 (15:55 +0000)]
Infra: Ansible Nomad III

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6c37287e79e48ba40a5dda497cc3614c367230aa

3 years agoTrending: Sorting in weekly comparison 27/27227/10
Tibor Frank [Mon, 25 May 2020 05:38:40 +0000 (07:38 +0200)]
Trending: Sorting in weekly comparison

Change-Id: I4e143a1f108f1c6975b24d2355bdac9f2a74ab46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad II 16/27216/2
pmikus [Fri, 22 May 2020 14:46:43 +0000 (14:46 +0000)]
Infra: Ansible Nomad II

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iaa5c02d14223b578c316f48e31a0b3613303eecf

3 years agoTRIGGER REPORT Master 86/26786/22
Tibor Frank [Wed, 29 Apr 2020 08:58:44 +0000 (08:58 +0000)]
TRIGGER REPORT Master

 - DO NOT MERGE

Change-Id: Idc8c24d443a3fbb2b3344e4c4fcbf3d7ab3fe0d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2001: Add data 14/27214/1
Tibor Frank [Fri, 22 May 2020 11:15:59 +0000 (13:15 +0200)]
Report 2001: Add data

Change-Id: I163af32bbecafdeed14a8deb32e9ec0c66980d31
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1703: Trending: Improve sorting in the dashboard 07/27207/2
Tibor Frank [Fri, 22 May 2020 06:25:29 +0000 (08:25 +0200)]
CSIT-1703: Trending: Improve sorting in the dashboard

New order:

1. regressions,
2. progressions,
3. short-term diff,
4. long-term diff,
5. test name.

Change-Id: Ie232d6759a088173fd56e2563c293cdfac352a98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2001: Add data 08/27208/1
Tibor Frank [Fri, 22 May 2020 07:33:22 +0000 (09:33 +0200)]
Report 2001: Add data

Change-Id: I8609e1d0a7cc4e8a641b947a4382dd4f64d0c981
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Colors in graphs 2 06/27206/1
Tibor Frank [Fri, 22 May 2020 04:48:24 +0000 (06:48 +0200)]
PAL: Colors in graphs 2

Change-Id: I69d341de8fde562d4d514954fa6b094ef1204489
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad 73/27173/10
pmikus [Wed, 20 May 2020 10:07:36 +0000 (10:07 +0000)]
Infra: Ansible Nomad

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Icc03bf62d8639f603ca90aa6ab849a46dc911d56

3 years agoPAL: Colors in graphs 71/27171/3
Tibor Frank [Wed, 20 May 2020 08:21:57 +0000 (10:21 +0200)]
PAL: Colors in graphs

Change-Id: I23b792ab01dc433e31c7d5eb5c48a95e5a2ec210
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2001: Add data 90/27190/1
Tibor Frank [Thu, 21 May 2020 07:52:19 +0000 (09:52 +0200)]
Report 2001: Add data

Change-Id: I34bc36a430f207be0c374540713f70e877b8fcf9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible maintenance 82/27182/1
pmikus [Wed, 20 May 2020 15:05:49 +0000 (15:05 +0000)]
Infra: Ansible maintenance

+ As per last discoveries when running from_scratch vs. append_only

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8b44314185bbc157a67136730dc6146d133c7cc4

3 years agoReport 2001: Add pdf version 80/27180/1
Tibor Frank [Wed, 20 May 2020 13:49:44 +0000 (15:49 +0200)]
Report 2001: Add pdf version

Change-Id: I2c46c10dff61633cffae39d2a835d9c29ef2573d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agorls2001: report update typos in vpp perf rls notes 49/27149/1
Maciek Konstantynowicz [Wed, 20 May 2020 13:36:07 +0000 (14:36 +0100)]
rls2001: report update typos in vpp perf rls notes

Change-Id: I3e271b1a8cc4c9360d17e4b2b0e562fe7446e555
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2b2e6d0ca56d430cfbbc47659a3e26629586cfef)

3 years agoAnsible: Mount /tmp as tmpfs 22/26922/4
pmikus [Wed, 6 May 2020 13:18:14 +0000 (13:18 +0000)]
Ansible: Mount /tmp as tmpfs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I69d9290d42c154f54e71e769a3a5d89a69c2e602

3 years agoReport: Add data 70/27170/1
Tibor Frank [Wed, 20 May 2020 07:36:58 +0000 (09:36 +0200)]
Report: Add data

+ 2n-clx

Change-Id: I291f05a6e2d1f95f18c09efde5549109b0696481
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data 69/27169/2
Tibor Frank [Wed, 20 May 2020 07:26:40 +0000 (09:26 +0200)]
Report: Add data

Change-Id: I6dad9dc40de95e8e878e01a30c4f8a3c7f0c60f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 16/27116/2
Jan Gelety [Fri, 8 May 2020 05:57:00 +0000 (07:57 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~25-g97086e18a

 - use new vpp ref build - centos7:
   20.09-rc0~25_g97086e1~b9499

Change-Id: Id51dd5a17b2b11a2e5d695cb4b12cfc70c19dbc9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 33/27133/1
Tibor Frank [Tue, 19 May 2020 07:52:52 +0000 (09:52 +0200)]
Report: Add data

Change-Id: I2854a38bf7b5d4718cab947b247231c41a8368fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: CSIT-1717: Add links from dashboard to graphs 14/27114/9
Tibor Frank [Mon, 18 May 2020 06:16:52 +0000 (08:16 +0200)]
Trending: CSIT-1717: Add links from dashboard to graphs

+ fix TB names in alerts

Change-Id: Ia10e9b82b57e90f7ae4592bd6ecf8b71dea71cc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAdd csit-vpp-perf-report-iterative job 87/27087/3
Jan Gelety [Thu, 7 May 2020 20:53:56 +0000 (22:53 +0200)]
Add csit-vpp-perf-report-iterative job

- job will be used to collect vpp performance iterative data
  for csit report

Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 20/27120/1
Tibor Frank [Mon, 18 May 2020 09:20:24 +0000 (11:20 +0200)]
Report: Add data

Change-Id: Ie36c6b3ad7763071101912cf354bdd0c0c0bfa1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, configure 2001.21 00/27100/1
Tibor Frank [Fri, 15 May 2020 11:00:27 +0000 (13:00 +0200)]
Report: Add data, configure 2001.21

Change-Id: I8eb2b893989fa22282d4d940513a69e0c87bbfdb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Fix typos 99/27099/1
Tibor Frank [Fri, 15 May 2020 10:11:24 +0000 (12:11 +0200)]
Trending: Fix typos

Change-Id: If2ca4c859c89ad1fdfb9cf3980a7aaba6966c929
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending: Add alerts for NDRPDR weekly tests 92/27092/4
Tibor Frank [Fri, 15 May 2020 05:29:15 +0000 (07:29 +0200)]
Trending: Add alerts for NDRPDR weekly tests

Change-Id: I35a806f8dd61e2c6d6dca2cdcfa4f7131e061cea
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPerformance: Tests with virtio driver in VM 00/26100/15
Peter Mikus [Tue, 24 Mar 2020 11:03:03 +0000 (11:03 +0000)]
Performance: Tests with virtio driver in VM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20e01dfe83a961dc8202d33783a678d38e71cff2

3 years agoTrending: Add NDRPDR trending graphs 73/26973/19
Tibor Frank [Mon, 11 May 2020 12:40:23 +0000 (14:40 +0200)]
Trending: Add NDRPDR trending graphs

Change-Id: I57caf62b5084e36d8909330af68f766b50e3b748
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: Download only vpp packages 71/27071/1
Jan Gelety [Thu, 7 May 2020 15:05:30 +0000 (17:05 +0200)]
FIX: Download only vpp packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76
(cherry picked from commit 36237cf89a092fee57faa6b2b1726d40df493845)

3 years agoAnsible: Small maintenance 36/27036/2
pmikus [Wed, 13 May 2020 11:46:46 +0000 (11:46 +0000)]
Ansible: Small maintenance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I542401d77a777dfc2d930de626e19c1d8083941c

3 years agoExecute also show runtime CLI 62/25362/14
Vratko Polak [Thu, 9 Apr 2020 09:03:28 +0000 (11:03 +0200)]
Execute also show runtime CLI

Example of a test with missing info:
https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-clx/287/archives/log.html.gz#s1-s1-s1-s4-s8-t3-k2-k9-k1-k1-k4-k1
- Missing any -outpt and -tx nodes.
- Zeros in vectors in rdma-input node (even though calls are there).

Placing the CLI call after the stats one,
to confirm stats does not "break" the CLI.

+ Using an earlier parent, to dodge some test failures.

Change-Id: I79072b54b6bf964dab4f21428e186394bafda72a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoInfra: PIP installation freeze 30/27030/5
pmikus [Wed, 13 May 2020 06:06:47 +0000 (06:06 +0000)]
Infra: PIP installation freeze

+ Waiting for Docker image to be updated. Then next step
  I will disable any update attempt.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599

3 years agojob-specs: new job test spec files including test count and durations 19/25619/9
Jan Gelety [Tue, 3 Mar 2020 14:55:27 +0000 (15:55 +0100)]
job-specs: new job test spec files including test count and durations

Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Disable pdf version 35/27035/1
Tibor Frank [Wed, 13 May 2020 11:37:45 +0000 (13:37 +0200)]
Report: Disable pdf version

Change-Id: I1dd0c4289c1318916b5351b378db8a85f136539f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add perf-sel set to oper tables 34/27034/1
Tibor Frank [Wed, 13 May 2020 11:34:26 +0000 (13:34 +0200)]
Report: Add perf-sel set to oper tables

Change-Id: If63bae7ee3dc439633e69e5b507dcaf262fabadf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: SRv6 encap 32/27032/1
Jan Gelety [Thu, 7 May 2020 02:41:16 +0000 (04:41 +0200)]
FIX: SRv6 encap

Change-Id: I4b75b343fc144489d81f82dbb4917b4a70a9911b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Fix bad chars for LaTex 31/27031/1
Tibor Frank [Wed, 13 May 2020 07:58:15 +0000 (09:58 +0200)]
Report: Fix bad chars for LaTex

Change-Id: I776dbe0ef7761dbc647b22f709ea1debbeddd718
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, add pdf version 28/27028/1
Tibor Frank [Wed, 13 May 2020 04:42:30 +0000 (06:42 +0200)]
Report: Add data, add pdf version

Change-Id: I8c972aa7a1689494adc93d9c3c881e419913f47e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: L3fwd properly 18/27018/2
pmikus [Tue, 12 May 2020 13:39:57 +0000 (13:39 +0000)]
FIX: L3fwd properly

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881

3 years agoReport CSIT-2001: updated rls notes for VPP. 11/27011/4
Maciek Konstantynowicz [Tue, 12 May 2020 11:09:26 +0000 (12:09 +0100)]
Report CSIT-2001: updated rls notes for VPP.

Change-Id: I64853402cf6301a99ee97a463a5984516b52b0d3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport CSIT-2001: updated CSIT environment ver. 2 date to 2020-03-27 per repo. 13/27013/1
Maciek Konstantynowicz [Tue, 12 May 2020 11:36:59 +0000 (12:36 +0100)]
Report CSIT-2001: updated CSIT environment ver. 2 date to 2020-03-27 per repo.

Change-Id: Id797295397c7159264ce7f457e6fd60af3d805bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2001: updated 2n-/3n-skx RCA yaml files with jira tickets. 09/27009/3
Maciek Konstantynowicz [Tue, 12 May 2020 10:17:12 +0000 (11:17 +0100)]
Report 2001: updated 2n-/3n-skx RCA yaml files with jira tickets.

Change-Id: I79b874ad00b0d8a0be80de0be52df656a2ce36d6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Fix header of comp tables, add data 07/27007/1
Tibor Frank [Tue, 12 May 2020 09:01:46 +0000 (11:01 +0200)]
Report: Fix header of comp tables, add data

Change-Id: I6d8727a08dce888bfbc620ebe34b6bd35bac488b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1597 API cleanup: ipsec 07/26807/3
Jan Gelety [Wed, 29 Apr 2020 06:24:16 +0000 (08:24 +0200)]
CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26276
- update vpp stable to version 20.05-rc0~727

Change-Id: I39a0b5e60fac6a74aff2426f6a448c0e117ab647
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Update to version numbering for RCA tables 74/26974/3
Tibor Frank [Mon, 11 May 2020 12:51:39 +0000 (14:51 +0200)]
Report: Update to version numbering for RCA tables

Change-Id: I7af3ef9ad545fa31477fc8f3403156c6aaea82f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate RCA1, RCA2 descriptions for 2n-skx, 3n-skx. 14/26814/4
Vratko Polak [Mon, 4 May 2020 09:10:00 +0000 (11:10 +0200)]
Update RCA1, RCA2 descriptions for 2n-skx, 3n-skx.

Change-Id: I729229a42a00aa4b93cb3d8331718413ca9e297c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Configure report 2001.20 38/26938/2
Tibor Frank [Thu, 7 May 2020 08:19:56 +0000 (10:19 +0200)]
Report: Configure report 2001.20

Change-Id: Ib0a3190dfd5b216aa9ff93d751fa48cd42cef88f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoperf: refactor 'setup suite topology interfaces' 52/26652/13
Dave Wallace [Thu, 23 Apr 2020 01:00:39 +0000 (01:00 +0000)]
perf: refactor 'setup suite topology interfaces'

- and 'setup suite topology interfaces no tg' to
  use a common keyword to create suite variables
  using the required topology information.

Change-Id: I46894948bc86eb7ce72d036e5b84f09c5c1385db
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
3 years agoReport: Add data 37/26937/1
Tibor Frank [Thu, 7 May 2020 08:10:15 +0000 (10:10 +0200)]
Report: Add data

Change-Id: If1d8025104b0cb04eee138d77c5c50c774a52753
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAnsible: Pre-check tests 47/26747/5
Peter Mikus [Tue, 28 Apr 2020 12:50:18 +0000 (12:50 +0000)]
Ansible: Pre-check tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I745ceb519220c4d08951dff07350f2f4709f3533