Report 2005: Add data

Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8ac495fdf576693d4c627a3211765facc688cfdc)

Reporet 2005: Add data, Fix comparison columns

Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 94829f7603cc247d4e675c1a105ad27b073cb92a)

Report 2005: Add data

Change-Id: I35803563351aa5419726a8a469f23557b49189f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e2d6dfa204eb3abef8845e742719cee7d4865ff7)

Report 2005: Add 3n-skx comp tables

Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 72019941bfab96c7e687f5122f50e7c1f8cb2fca)

Report 2005: Add data

Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8bfc85eef3f6214200cf7eb8d426d96de923e985)

report: updated rls notes for vpp performance section

Change-Id: I114c7d64c24210df4273086757ef33735baffe94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0074e91ecc792db04f82f51dc760ddf29375dc13)

Report: Improve soak_tests/index.rst

- The -iterative- jobs should be used in future,
  but for 2005 the results still come from -verify- jobs.

Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit a216afda94f4e23ecc50e03587e31b754d0f0116)

Report 2005: Add data, improve comp tables desc

Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e0f8fb48f1f569c78a92c075a66c256f1efb995b)

Report 2005: Add data

Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3c1b802a13265c776bcf0712989558bd9ff0ee1a)

Report 2005: Update comp tables, add data

Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ac9ae837b482f0220fea4f44a4eb2e490e8fa9e)

Report 2005: Add env 2 data, update 3n-hsw comp tables

Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6d45a74ca33951a02b9a1bcc8b0e2cf2f9db8745)

Revert "Tweak TRex cores and RDMA pps limit"

This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197.
It was affecting 2005 performance, confusing comparisons.

The revert includes the RDMA limit.

Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 6b81daa7407cd62a7916a1405a79a1f1f11555c1)

Report 2005: Add data, remove obsolete graphs

Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5b683bf3a43e8c5de1a48e2a842b952b4a9d7ae5)

Report: Add data, 2n-skx-nfv, configure 2005.26

Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1a0f5d37b11bafc784985875540f0e99abec88c0)

Report 2005: Add data

Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac38e4639b25835273f69a91d2779cae115bae30)

Report 2005: Add data

Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b693006d4267dd19bb3ba3d873cdc8ce18d2fe92)

Report 2005: Add data

Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 399d51b81b2144ad84edf6ea423cb04d69777eab)

Report 2005: Add data

Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 226b126e78fe7095b4dbee82dcb308c890a3155c)

Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4d6365deba4c28a8bc305169bb60c47f666c4a87)

PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ae654a8ade2a310effa49723ed577f05812a97ec)

Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75f8f739279790828ead808be3ecaa5c77b3073c)

Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 19b2d3d3cc01a0c0ceab1569bf8f9ca3c848b424)

Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3efabd6b8d8730bd0fa1d8df9ad4850412f64469)

Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a6464e9cefe273bd3caea8b672895e208aeb0fcb)

Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 60b5545b670cbcb7813d0ca7d6748b83e48072c6)

Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7fb1dad82e15cd065e6aea8071374ae081ba3007)

Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9b2acc9eea24958d7a84b0b6e77c658497579824)

Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a37d06fd84d6653990e39c135252ef1623d0ccfd)

Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b366c098031d995015fea0a56113c29a5fcd9a68)

Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 566af41a85f6fb2fd6a6e0117456ec83d4e2a6c6)

docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6fa263815306b43ab1813360f0123e8a245b4b56)

docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1dbd6729f2a6ec77f0d9e867d2bf858d9b5db488)

docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6b5f02d7f004003e4d87d62f6add260ea126c0da)

Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 806a069bc5494d1c43dd9711e1512e518c823acd)

Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c056a4fe51febfae290209c0d39b23bd63b6542a)

Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 972b5c9a4f25982865067dc08325c7ea16cfcd96)

docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 61012e6fc1590376b327ebdc026be8278a277611)

docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 3921adc2cfbbdbba28ed94a3dd19bb80a0d85702)

docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 366ac57ae0c775c4e60326ee51ce6659f841c0a9)

docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a33f758a6bca9c48940e7d69476cb78274395765)

docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b4782ed542da67f619f1c043a8c6e23be81f715d)

Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d76c78f267719c6ecdff22a40689117ee8cc1266)

Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 6ebf54b7c0471d2723066e051307bff5561f63d1)

Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e84eec8494a5f13fce73e13dfdb38af90608edb7)

Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba7130cebc9bc6ef66b9eb4f0e7d888462e10e48)

Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fab22524dac3f5aaa26dde53f74d15974e29901)

Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4b145ea098f99b8305b5c94a66d3afa273e884f2)

Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c08ca318fa9e8ee7d1396d6e6173135afef684da)

Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 638d32aed060bfe3db655f46c3d052a4bd3ec0cd)

Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1780255993d981987fad2e27a3afef71532a060a)

FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf
(cherry picked from commit 7b226db0db360edcf3062dc794d64d25eb5ed57b)
(cherry picked from commit 39f23d400066df1826910a7d59250c3cbf560651)

Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6a0b39bd8e0dd1bed25e98632ee45f9a88e071d3)

Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e1a91c854a401ff42319d50b7d53ffe8bd30bd0a)

Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bd3bcde273540e50602c24592c4aa41500ddcd85)

Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b6e80a6cb4386192e9cd87551e288b6d3b5f497c)

Report: Add data

Ticket: CSIT-1723
Type: data

Change-Id: Iae3abf0740160e96bcd3126af9a8be04abf22db3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bd85966e884d76dfb85bc1e6e4ee74658c01197)

Report 2005: Add data

Ticket: CSIT-1723
Type: data

Change-Id: I4459da5ab5648d68599e8405d230047a6f4be0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 96a729f3fc001724044835d06c8c143e31d3c636)

Report: Add data and dpdk comparison tables

+ data:
  + vpp-device
  + perf-sel-3n-hsw
  + dpdk-3n-hsw
  + dpdk-3n-skx
  + dpdk-2n-skx
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv

+ comparison tables current vs previous:
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv
  + dpdk-3n-tsh

Ticket: CSIT-1723
Type: data

Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f8103a10cf197c4b28a3d48abcf1bb6f16db5016)

FIX: check if testpmd is alive

Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 018dc06b3cf5fdd4733a1221f9592a48ddd6664c)

Remove hugepage dirs when killing dpdk

There could be directories under /dev/hugepages/ so remove those as
well.

Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 292604dff945080639021fb4ffe524c6aed3ff07)

Report: Fix links to html tables

Type: Fix

Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d91be0977ab077324d95d5a50702d4cb244b686a)

PAL: Improvements in tables and formatting

+ legend
+ footnote
+ output to log
+ fix formatting in the methodology section

Type: Improvements

Change-Id: I605615a602b239265fc6768a65c8d33dd793d4c4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 836cdd8930dd7383d5c59a4ae407864a1e03040f)

Use vpp 20.05-release packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I2b1163567a86924e1a321dae2f977385d8b0a604

FIX: do not fail when skipping patch for l3fwd

Change-Id: I1159fb29d43f61628922cdbd51313f710aa72f4a
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit cb0188995fc92673b0d5701207a3b4dc7801589c)

PAL: Fix table_comparison again

Change-Id: Ie408afd7bb8390ebe2fc90eca6daf8da44d22e3b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ea4fcebabfaac866d469a7b4355ac8df7732a0f)

PAL: Fix table_comparison

Type: Fix

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I532cdb0967708e48bc9f9c5e87f96f95acbb9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cab556a47fee3858bd3ef9fc33eb84a563f0e82d)

Report: configure report rls2005

Ticket: CSIT-1722
Type: feature

Change-Id: I76f7f323f000cbfc802c6206b6232665bb88448c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7248cf97d0f950cda2e1167478d44455e03ddc8d)

Report: Infra update

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie39585e88460d9a5e3764726d93dc065f5cbacfb
(cherry picked from commit 9c459a2b303eb8d776ac040bc82830d850a67623)

FIX: add dpdk mrr_weekly and report_iterative job specs

- split job specs to directories

Change-Id: I9a71621216ab0bdf85d147ce03f473e7cbb0b266
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit ae81c6c8ea54cd0ceee739fbce5d7e2445689ecb)

Add csit-vpp/dpdk-perf-report-coverage job and job specifications

- note: currently dpdk report-coverge test sets are equal to dpdk
  report-iterative test sets

Change-Id: Ib9a718bfea4b24842742f49ee2eca022aa8a08e5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit f7c08d2bd14872ad888df9b95b823ab1784aa737)

FIX: vts perf tests

Change-Id: Ie144c22575a7976da0c77e787e450355b73b0006
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc2

 - use new vpp ref build - centos7:
   20.05-rc2~b13

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Id1d17eff3839853468a3db4fd999e86b77d1a01c

Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   20.05-rc1~1-g765ef3767

 - use new vpp ref build - centos7:
   20.05-rc1~1_g765ef37~b3

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I7c33da770cdea3fca30f9ee40de4e1a453f11cbc

Add csit-vpp-perf-report-iterative job

- job will be used to collect vpp performance iterative data
  for csit report

Change-Id: I4cff5caa0a97d08b11f3eb9b72963deaf1b04c73
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit de08ebfec25d2d9bb3f3b46c07a5bcb9efd24d1c)

Ansible: Small maintenance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I542401d77a777dfc2d930de626e19c1d8083941c
(cherry picked from commit f9f7672ff42274dd05320c153cd8efc7a9986e7e)

Execute also show runtime CLI

Example of a test with missing info:
https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master-2n-clx/287/archives/log.html.gz#s1-s1-s1-s4-s8-t3-k2-k9-k1-k1-k4-k1
- Missing any -outpt and -tx nodes.
- Zeros in vectors in rdma-input node (even though calls are there).

Placing the CLI call after the stats one,
to confirm stats does not "break" the CLI.

+ Using an earlier parent, to dodge some test failures.

Change-Id: I79072b54b6bf964dab4f21428e186394bafda72a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

FIX: Download only vpp packages

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: I88682b972947d73ae8433b550bd5e96b0b7c2c76

Update of VPP_REPO_URL and VPP_STABLE_VER files

- use vpp builds from vpp stable/2005 branch

- use new vpp ref build - ubuntu 18.04:
  20.05-rc1

- use new vpp ref build - centos7:
  20.05-rc1~b2

Signed-off-by: Jan Gelety <jgelety@cisco.com>
Change-Id: Ic9827612b8f96d84ceef617ac6d4f4080e2ad08e

Infra: PIP installation freeze

+ Waiting for Docker image to be updated. Then next step
  I will disable any update attempt.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I92d4e27be0537a95473cd723a45e6185b26ce599
(cherry picked from commit 49bf78210fe2361beefd48b74e76f96484b5abd2)

job-specs: new job test spec files including test count and durations

Change-Id: I4ad87092bff1c072051ca1c7243d8dedb1c4576e
Signed-off-by: Jan Gelety <jgelety@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Report: Disable pdf version

Change-Id: I1dd0c4289c1318916b5351b378db8a85f136539f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Add perf-sel set to oper tables

Change-Id: If63bae7ee3dc439633e69e5b507dcaf262fabadf
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: SRv6 encap

Change-Id: I4b75b343fc144489d81f82dbb4917b4a70a9911b
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: Fix bad chars for LaTex

Change-Id: I776dbe0ef7761dbc647b22f709ea1debbeddd718
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Add data, add pdf version

Change-Id: I8c972aa7a1689494adc93d9c3c881e419913f47e
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: L3fwd properly

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibdfc0350a101c4815f25456176e25bb1d90fd881

Report CSIT-2001: updated rls notes for VPP.

Change-Id: I64853402cf6301a99ee97a463a5984516b52b0d3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Report CSIT-2001: updated CSIT environment ver. 2 date to 2020-03-27 per repo.

Change-Id: Id797295397c7159264ce7f457e6fd60af3d805bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Report 2001: updated 2n-/3n-skx RCA yaml files with jira tickets.

Change-Id: I79b874ad00b0d8a0be80de0be52df656a2ce36d6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Report: Fix header of comp tables, add data

Change-Id: I6d8727a08dce888bfbc620ebe34b6bd35bac488b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

CSIT-1597 API cleanup: ipsec

- cover API changes in VPP: https://gerrit.fd.io/r/c/vpp/+/26276
- update vpp stable to version 20.05-rc0~727

Change-Id: I39a0b5e60fac6a74aff2426f6a448c0e117ab647
Signed-off-by: Jan Gelety <jgelety@cisco.com>

Report: Update to version numbering for RCA tables

Change-Id: I7af3ef9ad545fa31477fc8f3403156c6aaea82f6
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Update RCA1, RCA2 descriptions for 2n-skx, 3n-skx.

Change-Id: I729229a42a00aa4b93cb3d8331718413ca9e297c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

Report: Configure report 2001.20

Change-Id: Ib0a3190dfd5b216aa9ff93d751fa48cd42cef88f
Signed-off-by: Tibor Frank <tifrank@cisco.com>

perf: refactor 'setup suite topology interfaces'

- and 'setup suite topology interfaces no tg' to
  use a common keyword to create suite variables
  using the required topology information.

Change-Id: I46894948bc86eb7ce72d036e5b84f09c5c1385db
Signed-off-by: Dave Wallace <dwallacelf@gmail.com>

Report: Add data

Change-Id: If1d8025104b0cb04eee138d77c5c50c774a52753
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Ansible: Pre-check tests

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I745ceb519220c4d08951dff07350f2f4709f3533

Trending: NDRPDR dashboard

Change-Id: I7f4c84dd47874c484f34f389b93de635c66a77c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

FIX: dot1q-ip6

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ied48646bd9de41e5a55e0006440d057c5fddf694

Ansible: Remove cobbler

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I34446125071ee7157e1c0e29027a6d973ee03c7e