csit.git
3 years agoSoak: Fix worker exception passing 96/27296/4
Vratko Polak [Wed, 27 May 2020 18:45:26 +0000 (20:45 +0200)]
Soak: Fix worker exception passing

Change-Id: I636f020e97df1b37ac8b6a30af511eebe611b56f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoSoak: Fix failure condition 67/27267/4
Vratko Polak [Tue, 26 May 2020 11:57:08 +0000 (13:57 +0200)]
Soak: Fix failure condition

Previously, number of directions was not taken into account.
Also, ideally PLRsearch never reports value under the hard minimum,
so successful results are now required to be more than 10% better.

Change-Id: I8622726b97bd1da3e139c8044a2932837fc268b7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 66/27866/2
Jan Gelety [Thu, 9 Jul 2020 09:28:37 +0000 (11:28 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~194-g52e9aaf0b

 - use new vpp ref build - centos7:
   20.09-rc0~193_gea7e708~b9670
   (build 20.09-rc0~197 not uploaded to packagecloud.io)

Change-Id: I3a6e284daf67e826eda184aa7a9af1dd3b7a6043
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport 2005: Fix titles in test env 69/27869/1
Tibor Frank [Mon, 13 Jul 2020 08:47:54 +0000 (10:47 +0200)]
Report 2005: Fix titles in test env

Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 67/27867/1
Tibor Frank [Mon, 13 Jul 2020 08:19:28 +0000 (10:19 +0200)]
Report 2005: Add data

- perf-iter-3n-tsh - 1 run
- perf-cov-3n-hsw - 35 runs

Change-Id: I9951cd2aa1883efa944b5c16b3b736761c1ff64f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Configure rls2005.39 65/27865/1
Tibor Frank [Mon, 13 Jul 2020 07:17:03 +0000 (09:17 +0200)]
Report 2005: Configure rls2005.39

Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: fixed misplaced environment versioning section 62/27862/3
Maciek Konstantynowicz [Fri, 10 Jul 2020 16:49:27 +0000 (18:49 +0200)]
report: fixed misplaced environment versioning section

Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoDocs: job-specs: dpdk and nfv-density test sets 50/27850/2
Tibor Frank [Fri, 10 Jul 2020 07:24:02 +0000 (09:24 +0200)]
Docs: job-specs: dpdk and nfv-density test sets

+ synchronize iter dpdk test sets with coverage dpdk test sets
+ add iter nfv-density-mrr test sets

Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRCA 2005: Update RCA files. 76/27676/9
Vratko Polak [Fri, 10 Jul 2020 10:10:01 +0000 (12:10 +0200)]
RCA 2005: Update RCA files.

+ Current state.
+ Covers skx (also 3n) and clx.
+ Specific Jira sub-tasks, even for VPP progressions.
- Only 2n-skx data for NDR.

Change-Id: I56cf870aedc1319891b7188268ff6cf7bc744ff8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoreport: added versioning sub-section to VPP Test Environment section 46/27846/3
Maciek Konstantynowicz [Thu, 9 Jul 2020 19:56:19 +0000 (21:56 +0200)]
report: added versioning sub-section to VPP Test Environment section

Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2005: Add data 49/27849/2
Tibor Frank [Fri, 10 Jul 2020 06:37:34 +0000 (08:37 +0200)]
Report 2005: Add data

Change-Id: I56b805eec6e5d606a954ba749b16ce72ce6047fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFramework: Allow change of MRR settings 01/27601/5
pmikus [Fri, 19 Jun 2020 12:18:58 +0000 (12:18 +0000)]
Framework: Allow change of MRR settings

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie88f0df239725a4de62d727e1923cdb3ad040809

3 years agoReport 2005: Add data, review graphs 20/27820/2
Tibor Frank [Thu, 9 Jul 2020 09:16:19 +0000 (11:16 +0200)]
Report 2005: Add data, review graphs

Change-Id: I2913ed579369a26a1226cfbe958432d1b3e11789
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, hide dnv, soak, reconf, nfv 14/27814/2
Tibor Frank [Wed, 8 Jul 2020 07:59:24 +0000 (09:59 +0200)]
Report 2005: Add data, hide dnv, soak, reconf, nfv

Change-Id: Iff1b1db3e31d2e1f19f8309ba28f1f88e0538f6c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoPAL: Improve comparison tables 05/27805/15
Tibor Frank [Tue, 7 Jul 2020 07:35:59 +0000 (09:35 +0200)]
PAL: Improve comparison tables

- place RCAs to the columns with diffs

CSIT-1737

Change-Id: I3ccf5ee510796684e3e09dbdc6264b05f391f633
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: 2005: Add data, configure rls2005.28 04/27804/1
Tibor Frank [Tue, 7 Jul 2020 07:26:02 +0000 (09:26 +0200)]
Report: 2005: Add data, configure rls2005.28

Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate TODOs for tox 01/27201/2
Vratko Polak [Thu, 21 May 2020 17:00:51 +0000 (19:00 +0200)]
Update TODOs for tox

Change-Id: I9368557aed7508d9401628c0ddfda475da42bc99
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data 93/27793/1
Tibor Frank [Sun, 5 Jul 2020 15:23:30 +0000 (17:23 +0200)]
Report 2005: Add data

Change-Id: Icc4ea692adcafef542dfa61e0fa594c85db6898e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 91/27791/1
Tibor Frank [Fri, 3 Jul 2020 10:00:41 +0000 (12:00 +0200)]
Report 2005: Add data

Change-Id: I8c0be475c73aa5c9c3d04780851faf25f1156aed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, change legend in comp tables 89/27789/1
Tibor Frank [Fri, 3 Jul 2020 07:41:57 +0000 (09:41 +0200)]
Report 2005: Add data, change legend in comp tables

Change-Id: I538751d928a547b9c168798f853903dd56887f47
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoTrending and report alignment 55/27755/4
Tibor Frank [Wed, 1 Jul 2020 11:58:40 +0000 (13:58 +0200)]
Trending and report alignment

- use test sets defined in report-iterative also for mrr
  tests and for mrr_daily and mlr_weekly

Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: add jlinkes ssh key to ARM nomad servers 57/27757/2
Juraj Linkeš [Wed, 1 Jul 2020 13:24:16 +0000 (15:24 +0200)]
Infra: add jlinkes ssh key to ARM nomad servers

Change-Id: Ie304118e6b1ecb06704e35bbbeccf7cc0f649e8b
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710 59/27759/1
Tibor Frank [Thu, 2 Jul 2020 08:40:01 +0000 (10:40 +0200)]
Report 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710

Change-Id: I8e8a7e88475a789f04767893866db2502ec5f8ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 58/27758/1
Tibor Frank [Thu, 2 Jul 2020 08:27:56 +0000 (10:27 +0200)]
Report 2005: Add data

Change-Id: I65e1a386a29faa9c890a526b8d264f4eabcbf382
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: added mrr tests for vpp and dpdk to job_specs/report_iterative 42/27742/2
Maciek Konstantynowicz [Tue, 30 Jun 2020 15:57:39 +0000 (16:57 +0100)]
docs: added mrr tests for vpp and dpdk to job_specs/report_iterative

Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Update ansible ARM dev server 54/27754/2
Juraj Linkeš [Wed, 1 Jul 2020 11:21:07 +0000 (13:21 +0200)]
Infra: Update ansible ARM dev server

Remove nomad installation from the ARM dev server and add a generic
vppdev user to it. Add ansible role dev for this.

Change-Id: Icb967ff18cbe939464ddb3d8dbce5101747e739f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoInfra: Update Ansible ARM Nomad 49/27749/1
Juraj Linkeš [Wed, 1 Jul 2020 08:34:41 +0000 (10:34 +0200)]
Infra: Update Ansible ARM Nomad

- Add three new ThunderX servers
- Mark two existing ThunderX servers as out of order, since
  they're inaccessible
- Fix microarchitecture of ARM build servers

Change-Id: I57f5f3f8436a9082a264eb4e0fa4faac77ad53be
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 48/27748/1
Tibor Frank [Wed, 1 Jul 2020 06:49:40 +0000 (08:49 +0200)]
Report 2005: Add data

+ 2001.0-4 vs 2001.0-2 for 3n-hsw

Change-Id: Ice05011ea79681ede74825ed8ae6be849ea06b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agomake graph node variant can be configured from gerrit trigger 96/27396/7
Yulong Pei [Tue, 2 Jun 2020 16:32:40 +0000 (00:32 +0800)]
make graph node variant can be configured from gerrit trigger

for example, below will trigger VPP with default code path test in CSIT,
"csit-2n-clx-perftest mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf"
and below will trigger VPP with avx512 code path test in CSIT,
"csit-2n-clx-perftest icl mrrAND64bANDnic_intel-xxv710ANDeth-l2bdbasemaclrnNOTdrv_avf"

Change-Id: Id3abf932203ce00f34f8643c5bc4d5fc4d3e6efb
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
3 years agoReport 2005: Add 3n-skx mrr env 4 data 31/27731/2
Tibor Frank [Tue, 30 Jun 2020 08:33:10 +0000 (10:33 +0200)]
Report 2005: Add 3n-skx mrr env 4 data

Change-Id: I44f05050c8e0c528c4980ac767232c497d058d9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Improve containers.rst 64/27564/9
Vratko Polak [Thu, 25 Jun 2020 13:06:00 +0000 (15:06 +0200)]
Report: Improve containers.rst

Change-Id: I2280b3f8c1977b47b222fa5ce3d47f90dc9b7e87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add 2n-clx and 3n-hsw mrr env 4 data 30/27730/1
Tibor Frank [Tue, 30 Jun 2020 05:13:33 +0000 (07:13 +0200)]
Report 2005: Add 2n-clx and 3n-hsw mrr env 4 data

Change-Id: I431215d96699381385199b61e9e5f37a581d91f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Replace data in thput graphs by env 4 22/27722/1
Tibor Frank [Mon, 29 Jun 2020 11:29:45 +0000 (13:29 +0200)]
Report 2005: Replace data in thput graphs by env 4

Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Configure rls2005.27, add data 15/27715/1
Tibor Frank [Mon, 29 Jun 2020 05:58:35 +0000 (07:58 +0200)]
Report 2005: Configure rls2005.27, add data

Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Fix comparison table hdr, add data 06/27706/3
Tibor Frank [Fri, 26 Jun 2020 10:14:27 +0000 (12:14 +0200)]
Report 2005: Fix comparison table hdr, add data

Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, fix sorting in comp tables 04/27704/1
Tibor Frank [Fri, 26 Jun 2020 06:52:46 +0000 (08:52 +0200)]
Report 2005: Add data, fix sorting in comp tables

Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 03/27703/1
Tibor Frank [Fri, 26 Jun 2020 04:40:24 +0000 (06:40 +0200)]
Report 2005: Add data

Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReporet 2005: Add data, Fix comparison columns 80/27680/1
Tibor Frank [Thu, 25 Jun 2020 18:36:25 +0000 (20:36 +0200)]
Reporet 2005: Add data, Fix comparison columns

Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 72/27672/2
Tibor Frank [Thu, 25 Jun 2020 09:40:19 +0000 (11:40 +0200)]
Report 2005: Add data

Change-Id: I35803563351aa5419726a8a469f23557b49189f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add 3n-skx comp tables 71/27671/1
Tibor Frank [Thu, 25 Jun 2020 08:09:23 +0000 (10:09 +0200)]
Report 2005: Add 3n-skx comp tables

Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 70/27670/1
Tibor Frank [Thu, 25 Jun 2020 07:39:32 +0000 (09:39 +0200)]
Report 2005: Add data

Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoreport: updated rls notes for vpp performance section 85/27585/5
Maciek Konstantynowicz [Wed, 17 Jun 2020 18:25:01 +0000 (19:25 +0100)]
report: updated rls notes for vpp performance section

Change-Id: I114c7d64c24210df4273086757ef33735baffe94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport: Improve soak_tests/index.rst 40/27540/5
Vratko Polak [Mon, 15 Jun 2020 15:39:00 +0000 (17:39 +0200)]
Report: Improve soak_tests/index.rst

- The -iterative- jobs should be used in future,
  but for 2005 the results still come from -verify- jobs.

Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data, improve comp tables desc 69/27669/1
Tibor Frank [Thu, 25 Jun 2020 06:04:49 +0000 (08:04 +0200)]
Report 2005: Add data, improve comp tables desc

Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 62/27662/1
Tibor Frank [Wed, 24 Jun 2020 14:09:53 +0000 (16:09 +0200)]
Report 2005: Add data

Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Update comp tables, add data 59/27659/1
Tibor Frank [Wed, 24 Jun 2020 11:46:51 +0000 (13:46 +0200)]
Report 2005: Update comp tables, add data

Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add env 2 data, update 3n-hsw comp tables 58/27658/1
Tibor Frank [Wed, 24 Jun 2020 09:59:41 +0000 (11:59 +0200)]
Report 2005: Add env 2 data, update 3n-hsw comp tables

Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoRevert "Tweak TRex cores and RDMA pps limit" 33/27633/2
Vratko Polak [Tue, 23 Jun 2020 12:08:05 +0000 (14:08 +0200)]
Revert "Tweak TRex cores and RDMA pps limit"

This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197.
It was affecting 2005 performance, confusing comparisons.

The revert includes the RDMA limit.

Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data, remove obsolete graphs 34/27634/1
Tibor Frank [Mon, 22 Jun 2020 12:03:40 +0000 (14:03 +0200)]
Report 2005: Add data, remove obsolete graphs

Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport: Add data, 2n-skx-nfv, configure 2005.26 31/27631/1
Tibor Frank [Mon, 22 Jun 2020 09:18:51 +0000 (11:18 +0200)]
Report: Add data, 2n-skx-nfv, configure 2005.26

Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 24/27624/1
Tibor Frank [Sat, 20 Jun 2020 06:52:06 +0000 (08:52 +0200)]
Report 2005: Add data

Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 22/27622/2
Tibor Frank [Fri, 19 Jun 2020 18:51:42 +0000 (20:51 +0200)]
Report 2005: Add data

Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 99/27599/1
Tibor Frank [Fri, 19 Jun 2020 09:09:00 +0000 (11:09 +0200)]
Report 2005: Add data

Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 92/27592/1
Tibor Frank [Thu, 18 Jun 2020 12:15:17 +0000 (14:15 +0200)]
Report 2005: Add data

Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoImprove release notes 15/25515/5
Vratko Polak [Mon, 15 Jun 2020 15:26:34 +0000 (17:26 +0200)]
Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoPAL: Use the reconf term from methodology 62/27562/3
Vratko Polak [Mon, 15 Jun 2020 15:54:55 +0000 (17:54 +0200)]
PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 years agoReport 2005: Add data 90/27590/1
Tibor Frank [Thu, 18 Jun 2020 07:55:46 +0000 (09:55 +0200)]
Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, remove plots without data 81/27581/1
Tibor Frank [Wed, 17 Jun 2020 11:12:06 +0000 (13:12 +0200)]
Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 78/27578/2
Tibor Frank [Wed, 17 Jun 2020 07:29:57 +0000 (09:29 +0200)]
Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoAWS 2n topology 30/27530/3
Maros Mullner [Mon, 15 Jun 2020 08:35:08 +0000 (10:35 +0200)]
AWS 2n topology

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Idc9317d3e37d9ed0a82adc273e0628a8defcfdf6

3 years agoNAT44-EI traffic profiles fix. 69/27569/2
Maros Mullner [Tue, 16 Jun 2020 05:40:11 +0000 (07:40 +0200)]
NAT44-EI traffic profiles fix.

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: I200d566aa94c2ae183aa3bc9db85a290f9da858d

3 years agoReport 2005: Fix graphs, tables 72/27572/1
Tibor Frank [Tue, 16 Jun 2020 10:20:50 +0000 (12:20 +0200)]
Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 70/27570/1
Tibor Frank [Tue, 16 Jun 2020 06:35:16 +0000 (08:35 +0200)]
Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 35/27535/1
Tibor Frank [Mon, 15 Jun 2020 12:25:50 +0000 (14:25 +0200)]
Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Clean-up graphs and tables 34/27534/2
Tibor Frank [Mon, 15 Jun 2020 11:25:06 +0000 (13:25 +0200)]
Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoUpdate of VPP_STABLE_VER files 28/27528/2
Jan Gelety [Fri, 29 May 2020 09:14:04 +0000 (11:14 +0200)]
Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.09-rc0~118-g1eae8ecb7

 - use new vpp ref build - centos7:
   20.09-rc0~118_g1eae8ec~b9594

Change-Id: I3d1d9154d6fe892c16918ed6760cfb7c6546e0f2
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoReport 2005: Add data, hide dpdk 3n-tsh 27/27527/1
Tibor Frank [Mon, 15 Jun 2020 07:59:40 +0000 (09:59 +0200)]
Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 22/27522/1
Tibor Frank [Fri, 12 Jun 2020 11:48:16 +0000 (13:48 +0200)]
Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 01/27501/1
Tibor Frank [Fri, 12 Jun 2020 09:43:01 +0000 (11:43 +0200)]
Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_iterative 85/27485/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:03:25 +0000 (13:03 +0100)]
docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-clx job_specs for report_iterative 84/27484/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 11:49:31 +0000 (12:49 +0100)]
docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_iterative 86/27486/3
Maciek Konstantynowicz [Wed, 10 Jun 2020 12:17:23 +0000 (13:17 +0100)]
docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoUpdate selection of report-iterative test sets 95/27495/1
Tibor Frank [Thu, 11 Jun 2020 10:17:41 +0000 (12:17 +0200)]
Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 93/27493/1
Tibor Frank [Thu, 11 Jun 2020 08:49:17 +0000 (10:49 +0200)]
Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, 2n-clx x533 cur vs prev tab 87/27487/1
Tibor Frank [Wed, 10 Jun 2020 13:51:55 +0000 (15:51 +0200)]
Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agodocs: update 3n-skx job_specs for report_coverage 75/27475/2
Maciek Konstantynowicz [Tue, 9 Jun 2020 15:51:42 +0000 (16:51 +0100)]
docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoReport 2005: Add data 82/27482/1
Tibor Frank [Wed, 10 Jun 2020 10:17:47 +0000 (12:17 +0200)]
Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoNAT44 EI tests 39/27339/16
Maros Mullner [Tue, 26 May 2020 06:11:49 +0000 (08:11 +0200)]
NAT44 EI tests

Signed-off-by: Maros Mullner <maros.mullner@pantheon.tech>
Change-Id: Ib5f58f60a1409ed139e2846793bf52fdc02a6571

3 years agoReport 2005: vpp-device static content 46/27446/2
Jan Gelety [Thu, 28 May 2020 20:50:12 +0000 (22:50 +0200)]
Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
3 years agoInfra: Ansible speed up 78/27478/1
pmikus [Wed, 10 Jun 2020 08:05:37 +0000 (08:05 +0000)]
Infra: Ansible speed up

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I24a22b1492593df937af2a17cd0c8684af7cd500

3 years agodocs: update 2n-dnv job_specs for report_coverage 50/27450/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:11:33 +0000 (13:11 +0100)]
docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-hsw job_specs for report_coverage 56/27456/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 18:24:34 +0000 (19:24 +0100)]
docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 2n-skx job_specs for report_coverage 49/27449/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 11:57:13 +0000 (12:57 +0100)]
docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agodocs: update 3n-dnv job_specs for report_coverage 52/27452/3
Maciek Konstantynowicz [Fri, 5 Jun 2020 12:53:25 +0000 (13:53 +0100)]
docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
3 years agoInfra: Ansible Nomad 61/27461/4
pmikus [Mon, 8 Jun 2020 06:43:19 +0000 (06:43 +0000)]
Infra: Ansible Nomad

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2560e3e12b457413db81a7ecc52efd7e39f1aea2

3 years agoRemove leading tc[nn] from test names 15/27215/4
Juraj Linkeš [Fri, 22 May 2020 12:25:24 +0000 (14:25 +0200)]
Remove leading tc[nn] from test names

The test names are unique without it and the information doesn't add
anything extra.

Change-Id: Idc7d6d1d21c8c05691e1757227a0a3787406d370
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 70/27470/1
Tibor Frank [Tue, 9 Jun 2020 07:49:21 +0000 (09:49 +0200)]
Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data, configure 2005.24 63/27463/1
Tibor Frank [Mon, 8 Jun 2020 10:14:09 +0000 (12:14 +0200)]
Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 20/27420/1
Tibor Frank [Thu, 4 Jun 2020 09:31:54 +0000 (11:31 +0200)]
Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 18/27418/1
Tibor Frank [Thu, 4 Jun 2020 08:17:52 +0000 (10:17 +0200)]
Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr 11/27411/1
Tibor Frank [Wed, 3 Jun 2020 13:56:08 +0000 (15:56 +0200)]
Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoInfra: Ansible Nomad 05/27405/2
pmikus [Wed, 3 Jun 2020 10:29:25 +0000 (10:29 +0000)]
Infra: Ansible Nomad

+ Prometheus Telemetry stanza
- ARM Softirons

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib7bf577ed0460ab5b79700ff0f8d52d5704cec59

3 years agoReport 2005: Fix wrong indentation in spec file 09/27409/1
Tibor Frank [Wed, 3 Jun 2020 12:59:13 +0000 (14:59 +0200)]
Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 08/27408/1
Tibor Frank [Wed, 3 Jun 2020 12:49:30 +0000 (14:49 +0200)]
Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoFIX: IP4 IP6 3n-only 06/27406/1
pmikus [Wed, 3 Jun 2020 10:52:37 +0000 (10:52 +0000)]
FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf

3 years agoFix DPDK build on arm 58/27358/4
Juraj Linkeš [Mon, 1 Jun 2020 08:40:52 +0000 (10:40 +0200)]
Fix DPDK build on arm

Directive #include <file> in GCC implementation searches for files
in a standard list of system directories, which leads to a build
error on Taishan arm machines:
/tmp/openvpp-testing/dpdk/lib/librte_ethdev/rte_ethdev.h:4287:10:
fatal error: rte_ethdev_core.h:
No such file or directory #include <rte_ethdev_core.h>

Fix this by replacing the directive with #include "file" which searches
for files first in the directory containing the current file and other
directories only after that.

Change-Id: If283b81c992c001a2f980312cdd99053c3d703d9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 years agoReport 2005: Add data 99/27399/1
Tibor Frank [Tue, 2 Jun 2020 18:38:52 +0000 (20:38 +0200)]
Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 89/27389/1
Tibor Frank [Tue, 2 Jun 2020 11:18:10 +0000 (13:18 +0200)]
Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 85/27385/1
Tibor Frank [Tue, 2 Jun 2020 09:16:36 +0000 (11:16 +0200)]
Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 years agoReport 2005: Add data 61/27361/2
Tibor Frank [Mon, 1 Jun 2020 11:56:46 +0000 (13:56 +0200)]
Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>