report: 2n-clx, 2n-skx, 3n-skx RCA edits in comparison tables

Change-Id: I9810b0b33355d880b606d7402564a3150d12397c
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7d81bdcc650170eaa304defbf6b3b006245697fb)

report: Updated vpp performance tests release notes

Change-Id: I1028f4fc9d0f38d70ba8b838a66f74274e534a40
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0c97a55b6e70752ddc538c4166f498efabf802c0)

Report 2005: Fix legend in comparison tables

Change-Id: I79265bb14c6daf75944ed596c21b9929f8524333
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c019e7db51461d5385ac5b26f708e6a25de85dec)

Report 2005: Add soak tests

Change-Id: Ib56215e906afba34d52b390ebc5a2d58bab4bf71
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 33d6c8475fa6e9f4a204f869ced4b2a802da5248)

Report 2005: Add NFV tests

- 2n-skx - ndrpdr, mrr
- 2n-clx - ndrpdr, mrr

Change-Id: I75f78a3986b17bb03187a4cc91260c4a60a7d515
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c22a63d5813100d9fbdc8f43ba58f3cd3546641b)

Report: remove wrk tests

Change-Id: Ie3f6ad2e4b5542e915f310c7b9ebeddf88b6fd8a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit faf579e9471ee8bd4e9c20beb40ed526d276b59c)

report: updated environment versioning section

Change-Id: I95adc8730d379286511398754042ad88b8c7d681
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit ca585727f655942827ea4db1ae0318485655a109)

Report: Improve vnf_service_chains_reconf.rst

+ Use the quantity name from methodology (not from test implementation).

Change-Id: Ic46f0447af840b392fe5dbbfec2bd11a847b06ca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 8e7e436b037a38cb9d5ad8b14abdfcbe64cf9cc6)

Report: vpp_performance_tests/overview.rst

Change-Id: I1c5c1a26574861e22485e7b40e19304bb635bc4a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 25f8a0f4a8f52fe1fee2d385cdfd40704fb4538c)

Docs: Update TRex information

The previous was describing CSIT version 3.

+ Stateless profile is now under GPL directory.

Change-Id: I9810ca224159053386557493eaf90b4aa682710e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit f619cc7649671f38fa23c11bf005a9acc4438bc1)

RCA 2005: Update status in RCA files

CSIT-1738, CSIT-1740 and CSIT-1741 are now DONE.

Change-Id: Id9b93ace9464a7e6af64f7860ad1a15c7a287a53
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 476e0bdbfce67873008fe1b3e0cfe59f64aec6c8)

RCA: Improve footnotes for ACL VPP.

+ Stateful ends with single l.

Change-Id: I7be89b3f536d05ed9b21ba8849a4eef33259d312
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2a9b24722825c3cf8ebed48d0d593cc3f91e722f)

Report 2005: Add reconf tests

Change-Id: Ic9466d4c0e6fb757e7d7c01d1aa83a59c1389371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc36a6a974e63722dbae42c552eb0d95ae7b95a9)

Report 2005: Fix titles in test env

Change-Id: I55e7a596d5fa23531e68d7ace9364411c3c372fc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6aed8b19c60ff81cad100c9c3a6931ce1686f38)

Report 2005: Add data

- perf-iter-3n-tsh - 1 run
- perf-cov-3n-hsw - 35 runs

Change-Id: I9951cd2aa1883efa944b5c16b3b736761c1ff64f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b9056e2936fa92ae0ec514db2eed482ce33679a0)

Report 2005: Configure rls2005.39

Change-Id: I7ea2e004b79d47420f6a1e0beb88731529b03706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f2606a6a0826cf95fd9fe0b0ff0eb43bffd8e8b7)

report: fixed misplaced environment versioning section

Change-Id: Id0da363b376e12dac583f95624ed6525b24290eb
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 30a988b35c6d66a11b5ec2f2c77c741dc942594e)

Docs: job-specs: dpdk and nfv-density test sets

+ synchronize iter dpdk test sets with coverage dpdk test sets
+ add iter nfv-density-mrr test sets

Change-Id: I759025b6acf860aca9828f9fc1d82ab3a37ec98f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bc42880dfa7c5d4c9abe8e6957e44752db10918e)

RCA 2005: Update RCA files.

+ Current state.
+ Covers skx (also 3n) and clx.
+ Specific Jira sub-tasks, even for VPP progressions.
- Only 2n-skx data for NDR.

Change-Id: I56cf870aedc1319891b7188268ff6cf7bc744ff8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 713e795d22717f69edf298d9dc4a16859206335f)

report: added versioning sub-section to VPP Test Environment section

Change-Id: I59a93c0594ab5e5f0e267cacdf03d1f345e02b29
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6c03d82f93fd0a4f0f7a7c750e18246260e11dd4)

Report 2005: Add data

Change-Id: I56b805eec6e5d606a954ba749b16ce72ce6047fa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d3612b6d641dbfc8013ac3e4d8f2a33b123742f3)

Report 2005: Add data, review graphs

Change-Id: I2913ed579369a26a1226cfbe958432d1b3e11789
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 12c3608c3464add7664e3b8f41b07b9b8fd03f1c)

Report 2005: Add data, hide dnv, soak, reconf, nfv

Change-Id: Iff1b1db3e31d2e1f19f8309ba28f1f88e0538f6c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d0f1e8778dac3549a1f1e403541de9f3ee88ec8d)

PAL: Improve comparison tables

- place RCAs to the columns with diffs

CSIT-1737

Change-Id: I3ccf5ee510796684e3e09dbdc6264b05f391f633
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ff8c8cf6083f64fd337115fec20501f7b247540e)

Report: 2005: Add data, configure rls2005.28

Change-Id: I686102fd7d17ad287ae890f1170ef7c78ff74a0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9439b30ba91e3532c66548c34bade4469fdfab37)

Report 2005: Add data

Change-Id: Icc4ea692adcafef542dfa61e0fa594c85db6898e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 921a1c6556b0d8a20a8e7ba2a48b887b41a30e60)

Report 2005: Add data

Change-Id: I8c0be475c73aa5c9c3d04780851faf25f1156aed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 617bf7e282e2eec5aaa9e33f98b0d65e6ac1874b)

Report 2005: Add data, change legend in comp tables

Change-Id: I538751d928a547b9c168798f853903dd56887f47
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f8f439e49ef481ceebac6cea76194bda83583927)

Trending and report alignment

- use test sets defined in report-iterative also for mrr
  tests and for mrr_daily and mlr_weekly

Change-Id: I47fba2997cddaca934bdebd5fca6936e25332afc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ea77fd004ce6dfbfe48d861743a9d14f99a620a4)

Report 2005: Fix data src for VPP Perf Changes 2n-clx-xxv710

Change-Id: I8e8a7e88475a789f04767893866db2502ec5f8ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75afcbc8614c69755c008e0d63eaf6ac79cb3184)

Report 2005: Add data

Change-Id: I65e1a386a29faa9c890a526b8d264f4eabcbf382
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e06ee18ddcd7287162afd6848121e9a094fee57)

docs: added mrr tests for vpp and dpdk to job_specs/report_iterative

Change-Id: Ie8fca17baa114fcdf5916e65311716a86e791709
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f4a8cf0ceadf483938ce10cce93942c0d7000a1e)

Report 2005: Add data

+ 2001.0-4 vs 2001.0-2 for 3n-hsw

Change-Id: Ice05011ea79681ede74825ed8ae6be849ea06b8f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 87940fb88ea6a32037fc0ee084fc9e423daa79a1)

Report 2005: Add 3n-skx mrr env 4 data

Change-Id: I44f05050c8e0c528c4980ac767232c497d058d9f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4cbb1b7c9aa616e377b73b9d22ed2b5ac1735b65)

Report 2005: Add 2n-clx and 3n-hsw mrr env 4 data

Change-Id: I431215d96699381385199b61e9e5f37a581d91f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3a97223e49e848614fcd3881ded46d147d36af82)

Report 2005: Replace data in thput graphs by env 4

Change-Id: I6bd871d85c7ca2ed9748a96b0568f8f3dab82008
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b478ee316158a56b7e9f1910edc84918bc7d9466)

Report 2005: Configure rls2005.27, add data

Change-Id: I6a9911b500d40708e2570be9d83cdd860c677977
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6349e9f96178bd0f6ef31cb2e5e8d1244c861724)

Report 2005: Fix comparison table hdr, add data

Change-Id: I3ef6dfb1b3da4f91c77841536a840a439816e61f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c9f903e4f7894cb61cf3cc67fb37c7602c917567)

Report 2005: Add data, fix sorting in comp tables

Change-Id: Ib0c42f5b9fbd9b9f9ebf0bff437ef9d145e6ddda
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f278b55927de4aa59cf87ac1e752effd1c64035c)

Report 2005: Add data

Change-Id: I7ffbe353739c3077bbfc03f25f4b6e03b2fdcccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8ac495fdf576693d4c627a3211765facc688cfdc)

Reporet 2005: Add data, Fix comparison columns

Change-Id: I83bd99c7afd63bd9ef0e432562c76cbe4ac8cb9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 94829f7603cc247d4e675c1a105ad27b073cb92a)

Report 2005: Add data

Change-Id: I35803563351aa5419726a8a469f23557b49189f2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e2d6dfa204eb3abef8845e742719cee7d4865ff7)

Report 2005: Add 3n-skx comp tables

Change-Id: Ic3237d165fdc9b7ca95498f724e0173f1cd29dad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 72019941bfab96c7e687f5122f50e7c1f8cb2fca)

Report 2005: Add data

Change-Id: I11c238327de71e75ca1ad099455f8daeb1ce996b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8bfc85eef3f6214200cf7eb8d426d96de923e985)

report: updated rls notes for vpp performance section

Change-Id: I114c7d64c24210df4273086757ef33735baffe94
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 0074e91ecc792db04f82f51dc760ddf29375dc13)

Report: Improve soak_tests/index.rst

- The -iterative- jobs should be used in future,
  but for 2005 the results still come from -verify- jobs.

Change-Id: Ief6651a17543f27a3ccfaf2861aa6f511d80127e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit a216afda94f4e23ecc50e03587e31b754d0f0116)

Report 2005: Add data, improve comp tables desc

Change-Id: I7d3afd5c3f6322cb76668b7ecfa288e9b64c6cc3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e0f8fb48f1f569c78a92c075a66c256f1efb995b)

Report 2005: Add data

Change-Id: Iffffa9dc7f87d0838cb674ffae01ca2407939dbe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3c1b802a13265c776bcf0712989558bd9ff0ee1a)

Report 2005: Update comp tables, add data

Change-Id: Ifcbf9e1f382ea33d0601f0bf52ad08b5f5f123a4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ac9ae837b482f0220fea4f44a4eb2e490e8fa9e)

Report 2005: Add env 2 data, update 3n-hsw comp tables

Change-Id: Ibaab929900abec2321a36ed1251d936d4327c927
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6d45a74ca33951a02b9a1bcc8b0e2cf2f9db8745)

Revert "Tweak TRex cores and RDMA pps limit"

This reverts commit 925c5bfcffb2bc6b833a8e64b7f3a06bbca52197.
It was affecting 2005 performance, confusing comparisons.

The revert includes the RDMA limit.

Change-Id: I9c31b061ee59bc5cb14d623ac98a65763ef75f1c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 6b81daa7407cd62a7916a1405a79a1f1f11555c1)

Report 2005: Add data, remove obsolete graphs

Change-Id: Id8b4d2d52bc35527cce0067cffa9ffb865ddfcce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5b683bf3a43e8c5de1a48e2a842b952b4a9d7ae5)

Report: Add data, 2n-skx-nfv, configure 2005.26

Change-Id: Ia00d19101e0521d89f23ee68be8e701b043a3a1e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1a0f5d37b11bafc784985875540f0e99abec88c0)

Report 2005: Add data

Change-Id: I0a3bdefce6dae7cbd297f47c6aaf9f631f909eb9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ac38e4639b25835273f69a91d2779cae115bae30)

Report 2005: Add data

Change-Id: Ie1d4677c91bfb3f9245dc553e3ca779f95c98ba1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b693006d4267dd19bb3ba3d873cdc8ce18d2fe92)

Report 2005: Add data

Change-Id: If87e87170d4d1dfd533265fa5b1c6875a770146e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 399d51b81b2144ad84edf6ea423cb04d69777eab)

Report 2005: Add data

Change-Id: I6b36e1c2fc42e37aa3cb42b79844c3581e17e430
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 226b126e78fe7095b4dbee82dcb308c890a3155c)

Improve release notes

+ Remove commented-out alternative notes.

Change-Id: Ib98348b00a2efa40f0b2e822681b1f5ba4e104fa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4d6365deba4c28a8bc305169bb60c47f666c4a87)

PAL: Use the reconf term from methodology

+ Instead of the term from test implementation.
+ The parser still looks for the old term.

Change-Id: Ic07ac336085f2bb07f9d906e83b82cb84ebddb24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ae654a8ade2a310effa49723ed577f05812a97ec)

Report 2005: Add data

Change-Id: I2d3dd84aca4a1a41e652e4fd0d67fe6cee56bdac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75f8f739279790828ead808be3ecaa5c77b3073c)

Report 2005: Add data, remove plots without data

Change-Id: Ia059695a18f3aa29a1bf7f16c2db17694c16b203
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 19b2d3d3cc01a0c0ceab1569bf8f9ca3c848b424)

Report 2005: Add data

Change-Id: I14d04b6251a74ade89f43f4733b5f16caccdbd72
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3efabd6b8d8730bd0fa1d8df9ad4850412f64469)

Report 2005: Fix graphs, tables

Change-Id: Id0ae3a74b796b2495157e21d09467cddfad2d12a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a6464e9cefe273bd3caea8b672895e208aeb0fcb)

Report 2005: Add data

Change-Id: I1ea07802294b498e61774038c3a2ae1bf6fffc7b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 60b5545b670cbcb7813d0ca7d6748b83e48072c6)

Report 2005: Add data

Change-Id: I022aaef58b1217476d5639bc00328fc56584ac40
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7fb1dad82e15cd065e6aea8071374ae081ba3007)

Report 2005: Clean-up graphs and tables

Change-Id: Ic0360a8a54e696aad5e7688d9f28808e868d1344
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9b2acc9eea24958d7a84b0b6e77c658497579824)

Report 2005: Add data, hide dpdk 3n-tsh

Change-Id: Id2c83dc218ad766008f65e2ad218eb01444cde07
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a37d06fd84d6653990e39c135252ef1623d0ccfd)

Report 2005: Add data

Change-Id: I86da78cc8b828afc6650a67c7d205ca8512f9cad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b366c098031d995015fea0a56113c29a5fcd9a68)

Report 2005: Add data

Change-Id: Ib5d8dd2b278865d1718c40383298b78d1e755759
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 566af41a85f6fb2fd6a6e0117456ec83d4e2a6c6)

docs: update 2n-skx job_specs for report_iterative

Changes in vpp-2n-skx.md:
- all nfv_density moved to separate file vpp-2n-skx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-skx/ and
  renamed

Change-Id: Iff16f6673ea3d829c44fbd04d892abb845fa4c1e
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6fa263815306b43ab1813360f0123e8a245b4b56)

docs: update 2n-clx job_specs for report_iterative

Changes in vpp-2n-clx.md:
- all nfv_density moved to separate file vpp-2n-clx-nfv-density.md
- removed intel-x710: dot1q
- removed drv_vfio_pci: vts, dot1q

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/2n-clx/ and
  renamed

Change-Id: I639abe794bde511d27cefa50db2860945dcc0050
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1dbd6729f2a6ec77f0d9e867d2bf858d9b5db488)

docs: update 3n-skx job_specs for report_iterative

Changes in vpp-3n-skx.md:
- all nfv_density moved to separate file vpp-3n-skx-nfv-density.md
- removed intel-x710: dot1q (except "./vm_vhost")
- removed drv_vfio_pci: dot1q, ipsec aes128cbc
- removed nat44, iacl, oacl

- Rebased on https://gerrit.fd.io/r/c/csit/+/27495
- *.md files moved to docs/job_specs/report_iterative/3n-skx/ and
  renamed

Change-Id: I952aeee65036919e35a2d98aaa5bb83743992966
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6b5f02d7f004003e4d87d62f6add260ea126c0da)

Update selection of report-iterative test sets

- Create the same directory structure for report-iterative as it is
  for report-coverage.
- Move files from report-iterative directory to created sub-directories.
- Rename the moved files to keep the convention defined in
  report-coverage.
- Update the corresponding functionality in
  resources/libraries/bash/function/common.sh

The patches:
- https://gerrit.fd.io/r/c/csit/+/27486
- https://gerrit.fd.io/r/c/csit/+/27484
- https://gerrit.fd.io/r/c/csit/+/27485
must be updated.

Change-Id: I1aaf22690e3df5abf56893bb1d2d380debc54ddd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 806a069bc5494d1c43dd9711e1512e518c823acd)

Report 2005: Add data

Change-Id: Iea03f5f49f68ef2f65040f778108592f7b44ead3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c056a4fe51febfae290209c0d39b23bd63b6542a)

Report 2005: Add data, 2n-clx x533 cur vs prev tab

CSIT-1727

Change-Id: Iaf445a99aae3e7bef3004347c9d26102c5b6777b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 972b5c9a4f25982865067dc08325c7ea16cfcd96)

docs: update 2n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ica29eda359bfb72f536cbe0c731c1142e5f13125
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 61012e6fc1590376b327ebdc026be8278a277611)

docs: update 3n-hsw job_specs for report_coverage

Removed for all tests: all packet sizes 4c, 9000B 2c.
Corrected NIC names: s/intel-vic1227/cisco-vic1227/, s/intel-vic1385/cisco-vic1385/

Change-Id: I9a5af4f689cbb2576d6f8fd090d13d50ad0b2f04
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 3921adc2cfbbdbba28ed94a3dd19bb80a0d85702)

docs: update 3n-dnv job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: I2af4aedc12aeccf6c860b2faf84721d6414b4b55
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 366ac57ae0c775c4e60326ee51ce6659f841c0a9)

docs: update 2n-skx job_specs for report_coverage

Removed tests: 9000B 4c, 9000B 2c, 1518B 4c.

Change-Id: Ia824679e5d1a724a4944676df89ebacc2889b602
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit a33f758a6bca9c48940e7d69476cb78274395765)

docs: update 3n-skx job_specs for report_coverage

Removed tests:
- crypto: 1518B 4c, ipsec-policy 2c 4c, ipsec-int-aes128cbc 2c 4c
- all non-crypto: 9000B 4c, 9000B 2c, 1518B 4c

Change-Id: I50de07ca6e12c3aa86832c1bdc83db4be48fe347
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b4782ed542da67f619f1c043a8c6e23be81f715d)

Report 2005: Add data

Change-Id: Ida07c263b93f30d146a32502245f425f898b87ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d76c78f267719c6ecdff22a40689117ee8cc1266)

Report 2005: vpp-device static content

Change-Id: I2dad290d1374d0354999ea53a592b1c4db0d9884
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 6ebf54b7c0471d2723066e051307bff5561f63d1)

Report 2005: Add data

Change-Id: I2b440c144a63720c2451f1b42d218f2e9d9c59bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e84eec8494a5f13fce73e13dfdb38af90608edb7)

Report 2005: Add data, configure 2005.24

Change-Id: Iabd8dadda4ee7e0b9fc7044f4fc6addf8a106ab5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ba7130cebc9bc6ef66b9eb4f0e7d888462e10e48)

Report 2005: Add data

Change-Id: I94f24c68c47cd3a93655d724b25e9cd0544d3400
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2fab22524dac3f5aaa26dde53f74d15974e29901)

Report 2005: Add data

Change-Id: Iab39f728760211694d1890078ba9db2fb7f18928
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4b145ea098f99b8305b5c94a66d3afa273e884f2)

Report 2005: Temporarily disable VPP Compare NICs 3n-skx ?t?c mrr

Change-Id: I7456a0bde176eb70492a4cc7be1412270b3e2b3d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c08ca318fa9e8ee7d1396d6e6173135afef684da)

Report 2005: Fix wrong indentation in spec file

Change-Id: Ifef31f84884cb9fd33d88e0806273905a4bb8e3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 638d32aed060bfe3db655f46c3d052a4bd3ec0cd)

Report 2005: Add data

Change-Id: I0599426a0980c61a7fb21e56e9a7d6574e21c75d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1780255993d981987fad2e27a3afef71532a060a)

FIX: IP4 IP6 3n-only

ARP not resolved as ARP plugin is not in use.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I655d39794f99e32a2f3905154d78e83853356ccf
(cherry picked from commit 7b226db0db360edcf3062dc794d64d25eb5ed57b)
(cherry picked from commit 39f23d400066df1826910a7d59250c3cbf560651)

Report 2005: Add data

Change-Id: I0a1fa4bdefef7a6335e0a99dba8945fa3e82f28f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6a0b39bd8e0dd1bed25e98632ee45f9a88e071d3)

Report 2005: Add data

Change-Id: Ic834b63c790396b4c8cce490cb084e4b3b2f93b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e1a91c854a401ff42319d50b7d53ffe8bd30bd0a)

Report 2005: Add data

Change-Id: I58928d0138d9a7aeec6b3b4fc842537587fd6a6b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bd3bcde273540e50602c24592c4aa41500ddcd85)

Report 2005: Add data

Change-Id: Ib5515b03089069f37c8b135efe47ed5f2058f358
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b6e80a6cb4386192e9cd87551e288b6d3b5f497c)

Report: Add data

Ticket: CSIT-1723
Type: data

Change-Id: Iae3abf0740160e96bcd3126af9a8be04abf22db3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bd85966e884d76dfb85bc1e6e4ee74658c01197)

Report 2005: Add data

Ticket: CSIT-1723
Type: data

Change-Id: I4459da5ab5648d68599e8405d230047a6f4be0ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 96a729f3fc001724044835d06c8c143e31d3c636)

Report: Add data and dpdk comparison tables

+ data:
  + vpp-device
  + perf-sel-3n-hsw
  + dpdk-3n-hsw
  + dpdk-3n-skx
  + dpdk-2n-skx
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv

+ comparison tables current vs previous:
  + dpdk-2n-clx
  + dpdk-2n-dnv
  + dpdk-3n-dnv
  + dpdk-3n-tsh

Ticket: CSIT-1723
Type: data

Change-Id: I3a29e7eb8f3a4106d2819362db0078c3b2091275
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f8103a10cf197c4b28a3d48abcf1bb6f16db5016)

FIX: check if testpmd is alive

Change-Id: I12f21a4a7ae7c8593c42fa8e6cc4d65e36d41270
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 018dc06b3cf5fdd4733a1221f9592a48ddd6664c)

Remove hugepage dirs when killing dpdk

There could be directories under /dev/hugepages/ so remove those as
well.

Change-Id: I8ecdde159b8e0049460d0bcdc8b1a2c85b1ed25f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 292604dff945080639021fb4ffe524c6aed3ff07)

Report: Fix links to html tables

Type: Fix

Change-Id: Ic4bc131ba7dac6c3f3e984a2fa224633a5cb6f86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d91be0977ab077324d95d5a50702d4cb244b686a)