csit.git
3 years agoReport: 2005: Add data, configure rls2005.28 04/27804/1
Tibor Frank [Tue, 7 Jul 2020 07:26:02 +0000 (09:26 +0200)]
Report: 2005: Add data, configure rls2005.28

Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate TODOs for tox 01/27201/2
Vratko Polak [Thu, 21 May 2020 17:00:51 +0000 (19:00 +0200)]
Update TODOs for tox

Change-Id: I9368557aed7508d9401628c0ddfda475da42bc99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data 93/27793/1
Tibor Frank [Sun, 5 Jul 2020 15:23:30 +0000 (17:23 +0200)]
Report 2005: Add data

Change-Id: Icc4ea692adcafef542dfa61e0fa594c85db6898e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 91/27791/1
Tibor Frank [Fri, 3 Jul 2020 10:00:41 +0000 (12:00 +0200)]
Report 2005: Add data

Change-Id: I8c0be475c73aa5c9c3d04780851faf25f1156aed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, change legend in comp tables 89/27789/1
Tibor Frank [Fri, 3 Jul 2020 07:41:57 +0000 (09:41 +0200)]
Report 2005: Add data, change legend in comp tables

Change-Id: I538751d928a547b9c168798f853903dd56887f47
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending and report alignment 55/27755/4
Tibor Frank [Wed, 1 Jul 2020 11:58:40 +0000 (13:58 +0200)]
Trending and report alignment

- use test sets defined in report-iterative also for mrr
  tests and for mrr_daily and mlr_weekly

Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: add jlinkes ssh key to ARM nomad servers 57/27757/2
Juraj Linkeš [Wed, 1 Jul 2020 13:24:16 +0000 (15:24 +0200)]
Infra: add jlinkes ssh key to ARM nomad servers

Change-Id: Ie304118e6b1ecb06704e35bbbeccf7cc0f649e8b
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710 59/27759/1
Tibor Frank [Thu, 2 Jul 2020 08:40:01 +0000 (10:40 +0200)]
Report 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710

Change-Id: I8e8a7e88475a789f04767893866db2502ec5f8ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 58/27758/1
Tibor Frank [Thu, 2 Jul 2020 08:27:56 +0000 (10:27 +0200)]
Report 2005: Add data

Change-Id: I65e1a386a29faa9c890a526b8d264f4eabcbf382
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: added mrr tests for vpp and dpdk to job_specs/report_iterative 42/27742/2
Maciek Konstantynowicz [Tue, 30 Jun 2020 15:57:39 +0000 (16:57 +0100)]
docs: added mrr tests for vpp and dpdk to job_specs/report_iterative

Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Update ansible ARM dev server 54/27754/2
Juraj Linkeš [Wed, 1 Jul 2020 11:21:07 +0000 (13:21 +0200)]
Infra: Update ansible ARM dev server

Remove nomad installation from the ARM dev server and add a generic
vppdev user to it. Add ansible role dev for this.

Change-Id: Icb967ff18cbe939464ddb3d8dbce5101747e739f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoInfra: Update Ansible ARM Nomad 49/27749/1
Juraj Linkeš [Wed, 1 Jul 2020 08:34:41 +0000 (10:34 +0200)]
Infra: Update Ansible ARM Nomad

- Add three new ThunderX servers
- Mark two existing ThunderX servers as out of order, since
  they're inaccessible
- Fix microarchitecture of ARM build servers

Change-Id: I57f5f3f8436a9082a264eb4e0fa4faac77ad53be
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 48/27748/1
Tibor Frank [Wed, 1 Jul 2020 06:49:40 +0000 (08:49 +0200)]
Report 2005: Add data

+ 2001.0-4 vs 2001.0-2 for 3n-hsw

Change-Id: Ice05011ea79681ede74825ed8ae6be849ea06b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agomake graph node variant can be configured from gerrit trigger 96/27396/7
Yulong Pei [Tue, 2 Jun 2020 16:32:40 +0000 (00:32 +0800)]
make graph node variant can be configured from gerrit trigger

for example, below will trigger VPP with default code path test in CSIT,
"csit-2n-clx-perftest mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf"
and below will trigger VPP with avx512 code path test in CSIT,
"csit-2n-clx-perftest icl mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf"

Change-Id: Id3abf932203ce00f34f8643c5bc4d5fc4d3e6efb
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
3 years agoReport 2005: Add 3n-skx mrr env 4 data 31/27731/2
Tibor Frank [Tue, 30 Jun 2020 08:33:10 +0000 (10:33 +0200)]
Report 2005: Add 3n-skx mrr env 4 data

Change-Id: I44f05050c8e0c528c4980ac767232c497d058d9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Improve containers.rst 64/27564/9
Vratko Polak [Thu, 25 Jun 2020 13:06:00 +0000 (15:06 +0200)]
Report: Improve containers.rst

Change-Id: I2280b3f8c1977b47b222fa5ce3d47f90dc9b7e87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add 2n-clx and 3n-hsw mrr env 4 data 30/27730/1
Tibor Frank [Tue, 30 Jun 2020 05:13:33 +0000 (07:13 +0200)]
Report 2005: Add 2n-clx and 3n-hsw mrr env 4 data

Change-Id: I431215d96699381385199b61e9e5f37a581d91f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Replace data in thput graphs by env 4 22/27722/1
Tibor Frank [Mon, 29 Jun 2020 11:29:45 +0000 (13:29 +0200)]
Report 2005: Replace data in thput graphs by env 4

Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Configure rls2005.27, add data 15/27715/1
Tibor Frank [Mon, 29 Jun 2020 05:58:35 +0000 (07:58 +0200)]
Report 2005: Configure rls2005.27, add data

Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Fix comparison table hdr, add data 06/27706/3
Tibor Frank [Fri, 26 Jun 2020 10:14:27 +0000 (12:14 +0200)]
Report 2005: Fix comparison table hdr, add data

Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, fix sorting in comp tables 04/27704/1
Tibor Frank [Fri, 26 Jun 2020 06:52:46 +0000 (08:52 +0200)]
Report 2005: Add data, fix sorting in comp tables

Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 03/27703/1
Tibor Frank [Fri, 26 Jun 2020 04:40:24 +0000 (06:40 +0200)]
Report 2005: Add data

Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReporet 2005: Add data, Fix comparison columns 80/27680/1
Tibor Frank [Thu, 25 Jun 2020 18:36:25 +0000 (20:36 +0200)]
Reporet 2005: Add data, Fix comparison columns

Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 72/27672/2
Tibor Frank [Thu, 25 Jun 2020 09:40:19 +0000 (11:40 +0200)]
Report 2005: Add data

Change-Id: I35803563351aa5419726a8a469f23557b49189f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add 3n-skx comp tables 71/27671/1
Tibor Frank [Thu, 25 Jun 2020 08:09:23 +0000 (10:09 +0200)]
Report 2005: Add 3n-skx comp tables

Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 70/27670/1
Tibor Frank [Thu, 25 Jun 2020 07:39:32 +0000 (09:39 +0200)]
Report 2005: Add data

Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: updated rls notes for vpp performance section 85/27585/5
Maciek Konstantynowicz [Wed, 17 Jun 2020 18:25:01 +0000 (19:25 +0100)]
report: updated rls notes for vpp performance section

Change-Id: I114c7d64c24210df4273086757ef33735baffe94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Improve soak_tests/index.rst 40/27540/5
Vratko Polak [Mon, 15 Jun 2020 15:39:00 +0000 (17:39 +0200)]
Report: Improve soak_tests/index.rst

- The -iterative- jobs should be used in future,
  but for 2005 the results still come from -verify- jobs.

Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data, improve comp tables desc 69/27669/1
Tibor Frank [Thu, 25 Jun 2020 06:04:49 +0000 (08:04 +0200)]
Report 2005: Add data, improve comp tables desc

Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 62/27662/1
Tibor Frank [Wed, 24 Jun 2020 14:09:53 +0000 (16:09 +0200)]
Report 2005: Add data

Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Update comp tables, add data 59/27659/1
Tibor Frank [Wed, 24 Jun 2020 11:46:51 +0000 (13:46 +0200)]
Report 2005: Update comp tables, add data

Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add env 2 data, update 3n-hsw comp tables 58/27658/1
Tibor Frank [Wed, 24 Jun 2020 09:59:41 +0000 (11:59 +0200)]
Report 2005: Add env 2 data, update 3n-hsw comp tables

Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRevert "Tweak TRex cores and RDMA pps limit" 33/27633/2
Vratko Polak [Tue, 23 Jun 2020 12:08:05 +0000 (14:08 +0200)]
Revert "Tweak TRex cores and RDMA pps limit"

This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197.
It was affecting 2005 performance, confusing comparisons.

The revert includes the RDMA limit.

Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data, remove obsolete graphs 34/27634/1
Tibor Frank [Mon, 22 Jun 2020 12:03:40 +0000 (14:03 +0200)]
Report 2005: Add data, remove obsolete graphs

Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, 2n-skx-nfv, configure 2005.26 31/27631/1
Tibor Frank [Mon, 22 Jun 2020 09:18:51 +0000 (11:18 +0200)]
Report: Add data, 2n-skx-nfv, configure 2005.26

Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 24/27624/1
Tibor Frank [Sat, 20 Jun 2020 06:52:06 +0000 (08:52 +0200)]
Report 2005: Add data

Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 22/27622/2
Tibor Frank [Fri, 19 Jun 2020 18:51:42 +0000 (20:51 +0200)]
Report 2005: Add data

Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 99/27599/1
Tibor Frank [Fri, 19 Jun 2020 09:09:00 +0000 (11:09 +0200)]
Report 2005: Add data

Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 92/27592/1
Tibor Frank [Thu, 18 Jun 2020 12:15:17 +0000 (14:15 +0200)]
Report 2005: Add data

Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoImprove release notes 15/25515/5
Vratko Polak [Mon, 15 Jun 2020 15:26:34 +0000 (17:26 +0200)]
Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoPAL: Use the reconf term from methodology 62/27562/3
Vratko Polak [Mon, 15 Jun 2020 15:54:55 +0000 (17:54 +0200)]
PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data 90/27590/1
Tibor Frank [Thu, 18 Jun 2020 07:55:46 +0000 (09:55 +0200)]
Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, remove plots without data 81/27581/1
Tibor Frank [Wed, 17 Jun 2020 11:12:06 +0000 (13:12 +0200)]
Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 78/27578/2
Tibor Frank [Wed, 17 Jun 2020 07:29:57 +0000 (09:29 +0200)]
Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAWS 2n topology 30/27530/3
Maros Mullner [Mon, 15 Jun 2020 08:35:08 +0000 (10:35 +0200)]
AWS 2n topology

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Idc9317d3e37d9ed0a82adc273e0628a8defcfdf6

3 years agoNAT44-EI traffic profiles fix. 69/27569/2
Maros Mullner [Tue, 16 Jun 2020 05:40:11 +0000 (07:40 +0200)]
NAT44-EI traffic profiles fix.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I200d566aa94c2ae183aa3bc9db85a290f9da858d

3 years agoReport 2005: Fix graphs, tables 72/27572/1
Tibor Frank [Tue, 16 Jun 2020 10:20:50 +0000 (12:20 +0200)]
Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 70/27570/1
Tibor Frank [Tue, 16 Jun 2020 06:35:16 +0000 (08:35 +0200)]
Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 35/27535/1
Tibor Frank [Mon, 15 Jun 2020 12:25:50 +0000 (14:25 +0200)]
Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Clean-up graphs and tables 34/27534/2
Tibor Frank [Mon, 15 Jun 2020 11:25:06 +0000 (13:25 +0200)]
Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 28/27528/2
Jan Gelety [Fri, 29 May 2020 09:14:04 +0000 (11:14 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~118-g1eae8ecb7

 - use new vpp ref build - centos7:
   20.09-rc0~118_g1eae8ec~b9594

Change-Id: I3d1d9154d6fe892c16918ed6760cfb7c6546e0f2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport 2005: Add data, hide dpdk 3n-tsh 27/27527/1
Tibor Frank [Mon, 15 Jun 2020 07:59:40 +0000 (09:59 +0200)]
Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 22/27522/1
Tibor Frank [Fri, 12 Jun 2020 11:48:16 +0000 (13:48 +0200)]
Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 01/27501/1
Tibor Frank [Fri, 12 Jun 2020 09:43:01 +0000 (11:43 +0200)]
Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_iterative 85/27485/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:03:25 +0000 (13:03 +0100)]
docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-clx job_specs for report_iterative 84/27484/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 11:49:31 +0000 (12:49 +0100)]
docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_iterative 86/27486/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:17:23 +0000 (13:17 +0100)]
docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoUpdate selection of report-iterative test sets 95/27495/1
Tibor Frank [Thu, 11 Jun 2020 10:17:41 +0000 (12:17 +0200)]
Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 93/27493/1
Tibor Frank [Thu, 11 Jun 2020 08:49:17 +0000 (10:49 +0200)]
Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, 2n-clx x533 cur vs prev tab 87/27487/1
Tibor Frank [Wed, 10 Jun 2020 13:51:55 +0000 (15:51 +0200)]
Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_coverage 75/27475/2
Maciek Konstantynowicz [Tue, 9 Jun 2020 15:51:42 +0000 (16:51 +0100)]
docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2005: Add data 82/27482/1
Tibor Frank [Wed, 10 Jun 2020 10:17:47 +0000 (12:17 +0200)]
Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoNAT44 EI tests 39/27339/16
Maros Mullner [Tue, 26 May 2020 06:11:49 +0000 (08:11 +0200)]
NAT44 EI tests

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ib5f58f60a1409ed139e2846793bf52fdc02a6571

3 years agoReport 2005: vpp-device static content 46/27446/2
Jan Gelety [Thu, 28 May 2020 20:50:12 +0000 (22:50 +0200)]
Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible speed up 78/27478/1
pmikus [Wed, 10 Jun 2020 08:05:37 +0000 (08:05 +0000)]
Infra: Ansible speed up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I24a22b1492593df937af2a17cd0c8684af7cd500

3 years agodocs: update 2n-dnv job_specs for report_coverage 50/27450/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:11:33 +0000 (13:11 +0100)]
docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-hsw job_specs for report_coverage 56/27456/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 18:24:34 +0000 (19:24 +0100)]
docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_coverage 49/27449/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 11:57:13 +0000 (12:57 +0100)]
docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-dnv job_specs for report_coverage 52/27452/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:53:25 +0000 (13:53 +0100)]
docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Ansible Nomad 61/27461/4
pmikus [Mon, 8 Jun 2020 06:43:19 +0000 (06:43 +0000)]
Infra: Ansible Nomad

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2560e3e12b457413db81a7ecc52efd7e39f1aea2

3 years agoRemove leading tc[nn] from test names 15/27215/4
Juraj Linkeš [Fri, 22 May 2020 12:25:24 +0000 (14:25 +0200)]
Remove leading tc[nn] from test names

The test names are unique without it and the information doesn't add
anything extra.

Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 70/27470/1
Tibor Frank [Tue, 9 Jun 2020 07:49:21 +0000 (09:49 +0200)]
Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, configure 2005.24 63/27463/1
Tibor Frank [Mon, 8 Jun 2020 10:14:09 +0000 (12:14 +0200)]
Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 20/27420/1
Tibor Frank [Thu, 4 Jun 2020 09:31:54 +0000 (11:31 +0200)]
Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 18/27418/1
Tibor Frank [Thu, 4 Jun 2020 08:17:52 +0000 (10:17 +0200)]
Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr 11/27411/1
Tibor Frank [Wed, 3 Jun 2020 13:56:08 +0000 (15:56 +0200)]
Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad 05/27405/2
pmikus [Wed, 3 Jun 2020 10:29:25 +0000 (10:29 +0000)]
Infra: Ansible Nomad

+ Prometheus Telemetry stanza
- ARM Softirons

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib7bf577ed0460ab5b79700ff0f8d52d5704cec59

3 years agoReport 2005: Fix wrong indentation in spec file 09/27409/1
Tibor Frank [Wed, 3 Jun 2020 12:59:13 +0000 (14:59 +0200)]
Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 08/27408/1
Tibor Frank [Wed, 3 Jun 2020 12:49:30 +0000 (14:49 +0200)]
Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: IP4 IP6 3n-only 06/27406/1
pmikus [Wed, 3 Jun 2020 10:52:37 +0000 (10:52 +0000)]
FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf

3 years agoFix DPDK build on arm 58/27358/4
Juraj Linkeš [Mon, 1 Jun 2020 08:40:52 +0000 (10:40 +0200)]
Fix DPDK build on arm

Directive #include <file> in GCC implementation searches for files
in a standard list of system directories, which leads to a build
error on Taishan arm machines:
/tmp/openvpp-testing/dpdk/lib/librte_ethdev/rte_ethdev.h:4287:10:
fatal error: rte_ethdev_core.h:
No such file or directory #include <rte_ethdev_core.h>

Fix this by replacing the directive with #include "file" which searches
for files first in the directory containing the current file and other
directories only after that.

Change-Id: If283b81c992c001a2f980312cdd99053c3d703d9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 99/27399/1
Tibor Frank [Tue, 2 Jun 2020 18:38:52 +0000 (20:38 +0200)]
Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 89/27389/1
Tibor Frank [Tue, 2 Jun 2020 11:18:10 +0000 (13:18 +0200)]
Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 85/27385/1
Tibor Frank [Tue, 2 Jun 2020 09:16:36 +0000 (11:16 +0200)]
Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 61/27361/2
Tibor Frank [Mon, 1 Jun 2020 11:56:46 +0000 (13:56 +0200)]
Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 60/27360/1
Jan Gelety [Wed, 27 May 2020 14:49:37 +0000 (16:49 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~84-g353535bb4

 - use new vpp ref build - centos7:
   20.09-rc0~84_g353535b~b9559

Change-Id: I6ae6565b18de498e494db29824f85701b3e37642
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport: Add data 59/27359/1
Tibor Frank [Mon, 1 Jun 2020 10:12:41 +0000 (12:12 +0200)]
Report: Add data

Ticket: CSIT-1723
Type: data

Change-Id: Iae3abf0740160e96bcd3126af9a8be04abf22db3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible ARM 57/27357/2
pmikus [Mon, 1 Jun 2020 07:47:03 +0000 (07:47 +0000)]
Infra: Ansible ARM

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iffdb12cc7013a38341a09df2f863ee7c56196bb0

3 years agoReport 2005: Add data 56/27356/1
Tibor Frank [Mon, 1 Jun 2020 06:32:03 +0000 (08:32 +0200)]
Report 2005: Add data

Ticket: CSIT-1723
Type: data

Change-Id: I4459da5ab5648d68599e8405d230047a6f4be0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 2n-clx job_specs for report_coverage 95/27295/2
Maciek Konstantynowicz [Wed, 27 May 2020 18:34:45 +0000 (19:34 +0100)]
docs: update 2n-clx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I676062f8ca4c6457f09165310d770d1e18fa59e3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Add data and dpdk comparison tables 37/27337/2
Tibor Frank [Fri, 29 May 2020 09:01:13 +0000 (11:01 +0200)]
Report: Add data and dpdk comparison tables

+ data:
  + vpp-device
  + perf-sel-3n-hsw
  + dpdk-3n-hsw
  + dpdk-3n-skx
  + dpdk-2n-skx
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv

+ comparison tables current vs previous:
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv
  + dpdk-3n-tsh

Ticket: CSIT-1723
Type: data

Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: check if testpmd is alive 31/27331/1
Jan Gelety [Wed, 27 May 2020 01:55:11 +0000 (03:55 +0200)]
FIX: check if testpmd is alive

Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoRemove hugepage dirs when killing dpdk 98/27298/2
Juraj Linkeš [Thu, 28 May 2020 06:52:21 +0000 (08:52 +0200)]
Remove hugepage dirs when killing dpdk

There could be directories under /dev/hugepages/ so remove those as
well.

Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport: Fix links to html tables 23/27323/2
Tibor Frank [Thu, 28 May 2020 09:50:45 +0000 (11:50 +0200)]
Report: Fix links to html tables

Type: Fix

Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 22/27322/2
Jan Gelety [Tue, 26 May 2020 18:50:29 +0000 (20:50 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~70-g7f475bf4b

 - use new vpp ref build - centos7:
   20.09-rc0~70_g7f475bf~b9545

Change-Id: I39a665fcdda0659ce9228cc43aac28fcbfa3a987
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoPAL: Improvements in tables and formatting 87/27287/4
Tibor Frank [Wed, 27 May 2020 10:57:58 +0000 (12:57 +0200)]
PAL: Improvements in tables and formatting

+ legend
+ footnote
+ output to log
+ fix formatting in the methodology section

Type: Improvements

Change-Id: I605615a602b239265fc6768a65c8d33dd793d4c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: do not fail when skipping patch for l3fwd 91/27291/1
Jan Gelety [Tue, 26 May 2020 13:10:07 +0000 (15:10 +0200)]
FIX: do not fail when skipping patch for l3fwd

Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoINFO: Add Juraj to committers 73/27273/3
Vratko Polak [Wed, 27 May 2020 14:26:12 +0000 (16:26 +0200)]
INFO: Add Juraj to committers

Change-Id: I5739a11dbe921291ea4aa0ee104556590fbe5228
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoTerraform and ansible changes for Cloud environment (AWS, Azure). 10/27210/4
Maros Mullner [Fri, 22 May 2020 06:27:07 +0000 (08:27 +0200)]
Terraform and ansible changes for Cloud environment (AWS, Azure).

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ic78b5dae22b67763b99c50a5f15d7dd16152d5d5

3 years agoPAL: Fix table_comparison again 85/27285/1
Tibor Frank [Wed, 27 May 2020 08:57:46 +0000 (10:57 +0200)]
PAL: Fix table_comparison again

Change-Id: Ie408afd7bb8390ebe2fc90eca6daf8da44d22e3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>