csit.git
3 years agoReport 2005: Add 2n-clx and 3n-hsw mrr env 4 data 30/27730/1
Tibor Frank [Tue, 30 Jun 2020 05:13:33 +0000 (07:13 +0200)]
Report 2005: Add 2n-clx and 3n-hsw mrr env 4 data

Change-Id: I431215d96699381385199b61e9e5f37a581d91f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Replace data in thput graphs by env 4 22/27722/1
Tibor Frank [Mon, 29 Jun 2020 11:29:45 +0000 (13:29 +0200)]
Report 2005: Replace data in thput graphs by env 4

Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Configure rls2005.27, add data 15/27715/1
Tibor Frank [Mon, 29 Jun 2020 05:58:35 +0000 (07:58 +0200)]
Report 2005: Configure rls2005.27, add data

Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Fix comparison table hdr, add data 06/27706/3
Tibor Frank [Fri, 26 Jun 2020 10:14:27 +0000 (12:14 +0200)]
Report 2005: Fix comparison table hdr, add data

Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, fix sorting in comp tables 04/27704/1
Tibor Frank [Fri, 26 Jun 2020 06:52:46 +0000 (08:52 +0200)]
Report 2005: Add data, fix sorting in comp tables

Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 03/27703/1
Tibor Frank [Fri, 26 Jun 2020 04:40:24 +0000 (06:40 +0200)]
Report 2005: Add data

Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReporet 2005: Add data, Fix comparison columns 80/27680/1
Tibor Frank [Thu, 25 Jun 2020 18:36:25 +0000 (20:36 +0200)]
Reporet 2005: Add data, Fix comparison columns

Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 72/27672/2
Tibor Frank [Thu, 25 Jun 2020 09:40:19 +0000 (11:40 +0200)]
Report 2005: Add data

Change-Id: I35803563351aa5419726a8a469f23557b49189f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add 3n-skx comp tables 71/27671/1
Tibor Frank [Thu, 25 Jun 2020 08:09:23 +0000 (10:09 +0200)]
Report 2005: Add 3n-skx comp tables

Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 70/27670/1
Tibor Frank [Thu, 25 Jun 2020 07:39:32 +0000 (09:39 +0200)]
Report 2005: Add data

Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: updated rls notes for vpp performance section 85/27585/5
Maciek Konstantynowicz [Wed, 17 Jun 2020 18:25:01 +0000 (19:25 +0100)]
report: updated rls notes for vpp performance section

Change-Id: I114c7d64c24210df4273086757ef33735baffe94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Improve soak_tests/index.rst 40/27540/5
Vratko Polak [Mon, 15 Jun 2020 15:39:00 +0000 (17:39 +0200)]
Report: Improve soak_tests/index.rst

- The -iterative- jobs should be used in future,
  but for 2005 the results still come from -verify- jobs.

Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data, improve comp tables desc 69/27669/1
Tibor Frank [Thu, 25 Jun 2020 06:04:49 +0000 (08:04 +0200)]
Report 2005: Add data, improve comp tables desc

Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 62/27662/1
Tibor Frank [Wed, 24 Jun 2020 14:09:53 +0000 (16:09 +0200)]
Report 2005: Add data

Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Update comp tables, add data 59/27659/1
Tibor Frank [Wed, 24 Jun 2020 11:46:51 +0000 (13:46 +0200)]
Report 2005: Update comp tables, add data

Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add env 2 data, update 3n-hsw comp tables 58/27658/1
Tibor Frank [Wed, 24 Jun 2020 09:59:41 +0000 (11:59 +0200)]
Report 2005: Add env 2 data, update 3n-hsw comp tables

Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRevert "Tweak TRex cores and RDMA pps limit" 33/27633/2
Vratko Polak [Tue, 23 Jun 2020 12:08:05 +0000 (14:08 +0200)]
Revert "Tweak TRex cores and RDMA pps limit"

This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197.
It was affecting 2005 performance, confusing comparisons.

The revert includes the RDMA limit.

Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data, remove obsolete graphs 34/27634/1
Tibor Frank [Mon, 22 Jun 2020 12:03:40 +0000 (14:03 +0200)]
Report 2005: Add data, remove obsolete graphs

Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, 2n-skx-nfv, configure 2005.26 31/27631/1
Tibor Frank [Mon, 22 Jun 2020 09:18:51 +0000 (11:18 +0200)]
Report: Add data, 2n-skx-nfv, configure 2005.26

Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 24/27624/1
Tibor Frank [Sat, 20 Jun 2020 06:52:06 +0000 (08:52 +0200)]
Report 2005: Add data

Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 22/27622/2
Tibor Frank [Fri, 19 Jun 2020 18:51:42 +0000 (20:51 +0200)]
Report 2005: Add data

Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 99/27599/1
Tibor Frank [Fri, 19 Jun 2020 09:09:00 +0000 (11:09 +0200)]
Report 2005: Add data

Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 92/27592/1
Tibor Frank [Thu, 18 Jun 2020 12:15:17 +0000 (14:15 +0200)]
Report 2005: Add data

Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoImprove release notes 15/25515/5
Vratko Polak [Mon, 15 Jun 2020 15:26:34 +0000 (17:26 +0200)]
Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoPAL: Use the reconf term from methodology 62/27562/3
Vratko Polak [Mon, 15 Jun 2020 15:54:55 +0000 (17:54 +0200)]
PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data 90/27590/1
Tibor Frank [Thu, 18 Jun 2020 07:55:46 +0000 (09:55 +0200)]
Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, remove plots without data 81/27581/1
Tibor Frank [Wed, 17 Jun 2020 11:12:06 +0000 (13:12 +0200)]
Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 78/27578/2
Tibor Frank [Wed, 17 Jun 2020 07:29:57 +0000 (09:29 +0200)]
Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAWS 2n topology 30/27530/3
Maros Mullner [Mon, 15 Jun 2020 08:35:08 +0000 (10:35 +0200)]
AWS 2n topology

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Idc9317d3e37d9ed0a82adc273e0628a8defcfdf6

3 years agoNAT44-EI traffic profiles fix. 69/27569/2
Maros Mullner [Tue, 16 Jun 2020 05:40:11 +0000 (07:40 +0200)]
NAT44-EI traffic profiles fix.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I200d566aa94c2ae183aa3bc9db85a290f9da858d

3 years agoReport 2005: Fix graphs, tables 72/27572/1
Tibor Frank [Tue, 16 Jun 2020 10:20:50 +0000 (12:20 +0200)]
Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 70/27570/1
Tibor Frank [Tue, 16 Jun 2020 06:35:16 +0000 (08:35 +0200)]
Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 35/27535/1
Tibor Frank [Mon, 15 Jun 2020 12:25:50 +0000 (14:25 +0200)]
Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Clean-up graphs and tables 34/27534/2
Tibor Frank [Mon, 15 Jun 2020 11:25:06 +0000 (13:25 +0200)]
Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 28/27528/2
Jan Gelety [Fri, 29 May 2020 09:14:04 +0000 (11:14 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~118-g1eae8ecb7

 - use new vpp ref build - centos7:
   20.09-rc0~118_g1eae8ec~b9594

Change-Id: I3d1d9154d6fe892c16918ed6760cfb7c6546e0f2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport 2005: Add data, hide dpdk 3n-tsh 27/27527/1
Tibor Frank [Mon, 15 Jun 2020 07:59:40 +0000 (09:59 +0200)]
Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 22/27522/1
Tibor Frank [Fri, 12 Jun 2020 11:48:16 +0000 (13:48 +0200)]
Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 01/27501/1
Tibor Frank [Fri, 12 Jun 2020 09:43:01 +0000 (11:43 +0200)]
Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_iterative 85/27485/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:03:25 +0000 (13:03 +0100)]
docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-clx job_specs for report_iterative 84/27484/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 11:49:31 +0000 (12:49 +0100)]
docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_iterative 86/27486/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:17:23 +0000 (13:17 +0100)]
docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoUpdate selection of report-iterative test sets 95/27495/1
Tibor Frank [Thu, 11 Jun 2020 10:17:41 +0000 (12:17 +0200)]
Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 93/27493/1
Tibor Frank [Thu, 11 Jun 2020 08:49:17 +0000 (10:49 +0200)]
Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, 2n-clx x533 cur vs prev tab 87/27487/1
Tibor Frank [Wed, 10 Jun 2020 13:51:55 +0000 (15:51 +0200)]
Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_coverage 75/27475/2
Maciek Konstantynowicz [Tue, 9 Jun 2020 15:51:42 +0000 (16:51 +0100)]
docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2005: Add data 82/27482/1
Tibor Frank [Wed, 10 Jun 2020 10:17:47 +0000 (12:17 +0200)]
Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoNAT44 EI tests 39/27339/16
Maros Mullner [Tue, 26 May 2020 06:11:49 +0000 (08:11 +0200)]
NAT44 EI tests

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ib5f58f60a1409ed139e2846793bf52fdc02a6571

3 years agoReport 2005: vpp-device static content 46/27446/2
Jan Gelety [Thu, 28 May 2020 20:50:12 +0000 (22:50 +0200)]
Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible speed up 78/27478/1
pmikus [Wed, 10 Jun 2020 08:05:37 +0000 (08:05 +0000)]
Infra: Ansible speed up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I24a22b1492593df937af2a17cd0c8684af7cd500

3 years agodocs: update 2n-dnv job_specs for report_coverage 50/27450/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:11:33 +0000 (13:11 +0100)]
docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-hsw job_specs for report_coverage 56/27456/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 18:24:34 +0000 (19:24 +0100)]
docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_coverage 49/27449/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 11:57:13 +0000 (12:57 +0100)]
docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-dnv job_specs for report_coverage 52/27452/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:53:25 +0000 (13:53 +0100)]
docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Ansible Nomad 61/27461/4
pmikus [Mon, 8 Jun 2020 06:43:19 +0000 (06:43 +0000)]
Infra: Ansible Nomad

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2560e3e12b457413db81a7ecc52efd7e39f1aea2

3 years agoRemove leading tc[nn] from test names 15/27215/4
Juraj Linkeš [Fri, 22 May 2020 12:25:24 +0000 (14:25 +0200)]
Remove leading tc[nn] from test names

The test names are unique without it and the information doesn't add
anything extra.

Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 70/27470/1
Tibor Frank [Tue, 9 Jun 2020 07:49:21 +0000 (09:49 +0200)]
Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, configure 2005.24 63/27463/1
Tibor Frank [Mon, 8 Jun 2020 10:14:09 +0000 (12:14 +0200)]
Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 20/27420/1
Tibor Frank [Thu, 4 Jun 2020 09:31:54 +0000 (11:31 +0200)]
Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 18/27418/1
Tibor Frank [Thu, 4 Jun 2020 08:17:52 +0000 (10:17 +0200)]
Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr 11/27411/1
Tibor Frank [Wed, 3 Jun 2020 13:56:08 +0000 (15:56 +0200)]
Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad 05/27405/2
pmikus [Wed, 3 Jun 2020 10:29:25 +0000 (10:29 +0000)]
Infra: Ansible Nomad

+ Prometheus Telemetry stanza
- ARM Softirons

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib7bf577ed0460ab5b79700ff0f8d52d5704cec59

3 years agoReport 2005: Fix wrong indentation in spec file 09/27409/1
Tibor Frank [Wed, 3 Jun 2020 12:59:13 +0000 (14:59 +0200)]
Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 08/27408/1
Tibor Frank [Wed, 3 Jun 2020 12:49:30 +0000 (14:49 +0200)]
Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: IP4 IP6 3n-only 06/27406/1
pmikus [Wed, 3 Jun 2020 10:52:37 +0000 (10:52 +0000)]
FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf

3 years agoFix DPDK build on arm 58/27358/4
Juraj Linkeš [Mon, 1 Jun 2020 08:40:52 +0000 (10:40 +0200)]
Fix DPDK build on arm

Directive #include <file> in GCC implementation searches for files
in a standard list of system directories, which leads to a build
error on Taishan arm machines:
/tmp/openvpp-testing/dpdk/lib/librte_ethdev/rte_ethdev.h:4287:10:
fatal error: rte_ethdev_core.h:
No such file or directory #include <rte_ethdev_core.h>

Fix this by replacing the directive with #include "file" which searches
for files first in the directory containing the current file and other
directories only after that.

Change-Id: If283b81c992c001a2f980312cdd99053c3d703d9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 99/27399/1
Tibor Frank [Tue, 2 Jun 2020 18:38:52 +0000 (20:38 +0200)]
Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 89/27389/1
Tibor Frank [Tue, 2 Jun 2020 11:18:10 +0000 (13:18 +0200)]
Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 85/27385/1
Tibor Frank [Tue, 2 Jun 2020 09:16:36 +0000 (11:16 +0200)]
Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 61/27361/2
Tibor Frank [Mon, 1 Jun 2020 11:56:46 +0000 (13:56 +0200)]
Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 60/27360/1
Jan Gelety [Wed, 27 May 2020 14:49:37 +0000 (16:49 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~84-g353535bb4

 - use new vpp ref build - centos7:
   20.09-rc0~84_g353535b~b9559

Change-Id: I6ae6565b18de498e494db29824f85701b3e37642
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 59/27359/1
Tibor Frank [Mon, 1 Jun 2020 10:12:41 +0000 (12:12 +0200)]
Report: Add data

Ticket: CSIT-1723
Type: data

Change-Id: Iae3abf0740160e96bcd3126af9a8be04abf22db3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible ARM 57/27357/2
pmikus [Mon, 1 Jun 2020 07:47:03 +0000 (07:47 +0000)]
Infra: Ansible ARM

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iffdb12cc7013a38341a09df2f863ee7c56196bb0

3 years agoReport 2005: Add data 56/27356/1
Tibor Frank [Mon, 1 Jun 2020 06:32:03 +0000 (08:32 +0200)]
Report 2005: Add data

Ticket: CSIT-1723
Type: data

Change-Id: I4459da5ab5648d68599e8405d230047a6f4be0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 2n-clx job_specs for report_coverage 95/27295/2
Maciek Konstantynowicz [Wed, 27 May 2020 18:34:45 +0000 (19:34 +0100)]
docs: update 2n-clx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I676062f8ca4c6457f09165310d770d1e18fa59e3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Add data and dpdk comparison tables 37/27337/2
Tibor Frank [Fri, 29 May 2020 09:01:13 +0000 (11:01 +0200)]
Report: Add data and dpdk comparison tables

+ data:
  + vpp-device
  + perf-sel-3n-hsw
  + dpdk-3n-hsw
  + dpdk-3n-skx
  + dpdk-2n-skx
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv

+ comparison tables current vs previous:
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv
  + dpdk-3n-tsh

Ticket: CSIT-1723
Type: data

Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: check if testpmd is alive 31/27331/1
Jan Gelety [Wed, 27 May 2020 01:55:11 +0000 (03:55 +0200)]
FIX: check if testpmd is alive

Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoRemove hugepage dirs when killing dpdk 98/27298/2
Juraj Linkeš [Thu, 28 May 2020 06:52:21 +0000 (08:52 +0200)]
Remove hugepage dirs when killing dpdk

There could be directories under /dev/hugepages/ so remove those as
well.

Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Fix links to html tables 23/27323/2
Tibor Frank [Thu, 28 May 2020 09:50:45 +0000 (11:50 +0200)]
Report: Fix links to html tables

Type: Fix

Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 22/27322/2
Jan Gelety [Tue, 26 May 2020 18:50:29 +0000 (20:50 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~70-g7f475bf4b

 - use new vpp ref build - centos7:
   20.09-rc0~70_g7f475bf~b9545

Change-Id: I39a665fcdda0659ce9228cc43aac28fcbfa3a987
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Improvements in tables and formatting 87/27287/4
Tibor Frank [Wed, 27 May 2020 10:57:58 +0000 (12:57 +0200)]
PAL: Improvements in tables and formatting

+ legend
+ footnote
+ output to log
+ fix formatting in the methodology section

Type: Improvements

Change-Id: I605615a602b239265fc6768a65c8d33dd793d4c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: do not fail when skipping patch for l3fwd 91/27291/1
Jan Gelety [Tue, 26 May 2020 13:10:07 +0000 (15:10 +0200)]
FIX: do not fail when skipping patch for l3fwd

Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoINFO: Add Juraj to committers 73/27273/3
Vratko Polak [Wed, 27 May 2020 14:26:12 +0000 (16:26 +0200)]
INFO: Add Juraj to committers

Change-Id: I5739a11dbe921291ea4aa0ee104556590fbe5228
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoTerraform and ansible changes for Cloud environment (AWS, Azure). 10/27210/4
Maros Mullner [Fri, 22 May 2020 06:27:07 +0000 (08:27 +0200)]
Terraform and ansible changes for Cloud environment (AWS, Azure).

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ic78b5dae22b67763b99c50a5f15d7dd16152d5d5

3 years agoPAL: Fix table_comparison again 85/27285/1
Tibor Frank [Wed, 27 May 2020 08:57:46 +0000 (10:57 +0200)]
PAL: Fix table_comparison again

Change-Id: Ie408afd7bb8390ebe2fc90eca6daf8da44d22e3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Fix table_comparison 83/27283/1
Tibor Frank [Wed, 27 May 2020 08:18:24 +0000 (10:18 +0200)]
PAL: Fix table_comparison

Type: Fix

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I532cdb0967708e48bc9f9c5e87f96f95acbb9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: configure report rls2005 72/27272/3
Tibor Frank [Tue, 26 May 2020 13:52:55 +0000 (15:52 +0200)]
Report: configure report rls2005

Ticket: CSIT-1722
Type: feature

Change-Id: I76f7f323f000cbfc802c6206b6232665bb88448c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: add dpdk mrr_weekly and report_iterative job specs 32/27232/2
Jan Gelety [Mon, 25 May 2020 15:50:28 +0000 (17:50 +0200)]
FIX: add dpdk mrr_weekly and report_iterative job specs

- split job specs to directories

Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoAdd csit-vpp/dpdk-perf-report-coverage job and job specifications 24/27124/7
Jan Gelety [Fri, 8 May 2020 10:38:01 +0000 (12:38 +0200)]
Add csit-vpp/dpdk-perf-report-coverage job and job specifications

- note: currently dpdk report-coverge test sets are equal to dpdk
  report-iterative test sets

Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoFIX: vts perf tests 40/27240/2
Jan Gelety [Mon, 25 May 2020 20:50:00 +0000 (22:50 +0200)]
FIX: vts perf tests

Change-Id: Ie144c22575a7976da0c77e787e450355b73b0006
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible Nomad IV 31/27231/2
pmikus [Mon, 25 May 2020 15:44:18 +0000 (15:44 +0000)]
Infra: Ansible Nomad IV

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I67ab84c2c2b34ce5ccc3a2de629c41460bb52e8c

3 years agoReport: Infra update 82/26882/15
pmikus [Tue, 5 May 2020 12:30:44 +0000 (12:30 +0000)]
Report: Infra update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie39585e88460d9a5e3764726d93dc065f5cbacfb

3 years agoUpdate of VPP_STABLE_VER files 29/27229/2
Jan Gelety [Mon, 25 May 2020 07:38:09 +0000 (09:38 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~45-gcbe053e14

 - use new vpp ref build - centos7:
   20.09-rc0~45_gcbe053e~b9520

Change-Id: I944e1344df05c4a6fbfe6079d0203a78a20e16c9
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible Nomad III 20/27220/3
pmikus [Fri, 22 May 2020 15:55:40 +0000 (15:55 +0000)]
Infra: Ansible Nomad III

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6c37287e79e48ba40a5dda497cc3614c367230aa

3 years agoTrending: Sorting in weekly comparison 27/27227/10
Tibor Frank [Mon, 25 May 2020 05:38:40 +0000 (07:38 +0200)]
Trending: Sorting in weekly comparison

Change-Id: I4e143a1f108f1c6975b24d2355bdac9f2a74ab46
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad II 16/27216/2
pmikus [Fri, 22 May 2020 14:46:43 +0000 (14:46 +0000)]
Infra: Ansible Nomad II

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iaa5c02d14223b578c316f48e31a0b3613303eecf

3 years agoTRIGGER REPORT Master 86/26786/22
Tibor Frank [Wed, 29 Apr 2020 08:58:44 +0000 (08:58 +0000)]
TRIGGER REPORT Master

 - DO NOT MERGE

Change-Id: Idc8c24d443a3fbb2b3344e4c4fcbf3d7ab3fe0d4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2001: Add data 14/27214/1
Tibor Frank [Fri, 22 May 2020 11:15:59 +0000 (13:15 +0200)]
Report 2001: Add data

Change-Id: I163af32bbecafdeed14a8deb32e9ec0c66980d31
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoCSIT-1703: Trending: Improve sorting in the dashboard 07/27207/2
Tibor Frank [Fri, 22 May 2020 06:25:29 +0000 (08:25 +0200)]
CSIT-1703: Trending: Improve sorting in the dashboard

New order:

1. regressions,
2. progressions,
3. short-term diff,
4. long-term diff,
5. test name.

Change-Id: Ie232d6759a088173fd56e2563c293cdfac352a98
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2001: Add data 08/27208/1
Tibor Frank [Fri, 22 May 2020 07:33:22 +0000 (09:33 +0200)]
Report 2001: Add data

Change-Id: I8609e1d0a7cc4e8a641b947a4382dd4f64d0c981
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Colors in graphs 2 06/27206/1
Tibor Frank [Fri, 22 May 2020 04:48:24 +0000 (06:48 +0200)]
PAL: Colors in graphs 2

Change-Id: I69d341de8fde562d4d514954fa6b094ef1204489
Signed-off-by: Tibor Frank <tifrank@cisco.com>