Revert "Report: Temporarily change report specs"

This reverts commit 455cbb5c2427444510536a377b320724df6132cf.

Reason for revert: Not needed.

Change-Id: Idc391d965958b3d1675b5312fedb8305f508f35b
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Temporarily change report specs

Change-Id: Ic99dc97e89ff72ebc02e04929d7ad1d2f234e14d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

PAL: Fix sh-run

- do not post-process telemetry data

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia381964ae0a1a36f30a8aee62fe3e12a72e51df1

vpp_device: bind to vfio-pci before running tests

In rare cases, binding the whole /dev/vfio folder will result in
unusable VFs:
notice dpdk EAL: Cannot open /dev/vfio/151: Device or resource busy

[0], section 4.3.1. provides some clues as to what's going on and how to
avoid the failure. Mounting /dev/vfio reset the file descriptors of all
devices under /dev/vfio. Vfio-pci creates a device when an interface is
bound to it. The rare failure then occurs when /dev/vfio is mounted
while a process is using the file descriptors result in that process
using invalid file descriptors (or file descriptors belonging to a
different VF).

Fix the issue by binding i40e and ice VFs to vfio-pci before containers
are created and make sure that the VFs are not unbound later in testing.
Only bind DUT VFs since the TG uses the kernel driver.

[0]: https://connect.redhat.com/sites/default/files/2021-03/Cloud Native Network Function Requirements.pdf

Ticket: CSIT-1794

Change-Id: I83db91b29d16669fb034b141ad247f6f796fdf64
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>

Migrate report/trending/docs to bash framework

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idf8462f15a2dd76b42dcaea9df6a0fc15a45503f
(cherry picked from commit 8079ed2ff7e2fdd41474d286b98cd9be19481f7a)

Report: Add tables with builds durations

Change-Id: I6e5d72b336ab68c9ffd74f9ab20d7cb0ed4b5fb3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6353e5b063a146fe4bd66437ef09f540b9f87514)

Trending: Fix links in alerting email

Change-Id: I2ce48ac826ab347365f38ef1dbfdfa4cae8f3fd3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ece79f53197aa36aa356f7fa1ce1dfe0b582ae86)

Report: configure rls2106.33

Change-Id: Ic7d1a776817dda52007bcebd663388cc4bd1fa66
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e32b39d83fb01c33dfc9ae540ff2b55c11b707cf)

Tox: Move logs to archive also on -1

Change-Id: Id29925da9c8e0bc0a28a9f4d38c332852c687317
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 8f9290d1594d35eb838c0c4c9d754b80a35e4a3a)

CI-MAN: Unify backups

+ tox must follow the $WORKSPACE/archives rule

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I717afded894c3a5468bbf5013b242be5e1a9cb6e
(cherry picked from commit 88483ff0a6b4b5ff5b0390d8ff2adeb9a857c1c3)

Report: Add icx rls data

Change-Id: I3f16f058b257f2f4ccb48bd5ff725c9161d1176f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cab67f5de29b46776a689423188c121f997cc321)

Infra: AWS self termination

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9ecd85d1086f6be1bbaf6a6925da362cc4c1a9ad
(cherry picked from commit 44784f12e7a1cfe42927bd301b90015ffa72b7d7)
(cherry picked from commit 56b334fb5044d0f29b6e8f91e16f067533196b50)

Infra: Add terraform no-color output.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I851e979c9b0db41c83facb92010c1b16885ee5a0
(cherry picked from commit 6de5c7fc4524c5121ed00dc2fa3ab34301d45215)
(cherry picked from commit 29d8ac190da8ff0a975614e3aad2f56ebe1b5efd)

report: indexed error message added to report emails

Report emails will contain error message index now.
Index assigned to error message is described at the end of report.

sample:
avf-dot1q-l2bdbasemaclrn-eth-2memif-1dcr                               25ge2p1xxv710  64b   2t1c[0] 4t2c[0] 8t4c[0]

Legend:

[0] - Failed to run 'cli_inband clear runtime' PAPI command on host xxx.xxx.xxx.xxx

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I6c71eb8a8767827e18f88a9a1142b899158a190c
(cherry picked from commit 03bf0dd6ea67ef2b1386733d0b2ce3489c6a7f3e)

RCA: Add CSIT-1791

Change-Id: Ibe9d8265ed1dc8a9c4d480211b3292ebae986e65
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 476faa27d66a604df8b72d9339668485c0430b3e)

Report: Improve RCA

First comment at VPP-1972 clarifies this is not a 2101 issue.

Change-Id: I0b9a7398c44fd8a69304f0931f245c746664c413
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 21f4ed750e8fbee7ecb5b4aa7dfa1090bdbf36a9)

FIX: Terraform installation

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2963520237c0bcc30836df3722a945060bd438d3
(cherry picked from commit 2674845e28c3f36e6290c78bd73c0a43b0ecca15)
(cherry picked from commit 0e5b90cc8dad50365de53fa80db9817066ac3f82)

FIX: Terraform install

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1bc29338bf677c5777474ea07954df4ca0ed0a31
(cherry picked from commit 13f4ec1dc98710d2cf226de3643dc5a0a6c5ac67)
(cherry picked from commit dbace27a91928d386f79943a2faa13411d14ff63)

Infra: Install terraform

+ Unless docker images gets updated

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I9d09b24ca7bef71dad5774ae2b5e2e67e7b8f285
(cherry picked from commit ddd2cc047694396928086482339588966a858fba)
(cherry picked from commit 62420b659ffa75edbfe7c8ac4f480dff5b01c27e)

Infra: Vault

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia6e728f98d20144c3771405b32933a77fe15b19b
(cherry picked from commit 73440ab332c51eb11405767d320bc496d9ebdbe7)
(cherry picked from commit bb2af29c186f681dcbbc3c26a5f091af6c7415d3)

Report: Configure rls2106.32

Change-Id: Ia4e7a2436e038cebaaa080dd7c86f6de1b39b018
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b4d1e09227919dfc966c10c0054c97f0620c2963)

Trending: Fix broken graphs

Change-Id: I73b9446e9e76811f88d6b0fa2ee657e7ae0ceab3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 13dfbc0ae758164c025b310136f78faf7160805f)

FIX: init_interface driver and sr-iov

Add checks for not unbinding a driver that is not bound and not
trying to remove VFs from interfaces not supporting SR-IOV.

Change-Id: Iae7ce37aabeadbb541fe9eac8b83b4ee18d028e6
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7d849ba64e10b8a7678845ee1dcc091e125dd124)

Docs: issues added to csit_release_notes

Change-Id: I2e47e1c494a3d83d005c605b4a9214e8561b1b1d
Signed-off-by: Viliam Luc <vluc@cisco.com>
(cherry picked from commit bb5f2a46e7acd6e85408610b09a15ca3f5bd3647)

report: add nic and drivers section to physical testbeds description

Change-Id: I75fd902e32b290e62f7eb9fcd8b2b5b7a4b713e6
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 61d020ed404923283dcd87424a7845dcd84bd66a)

Trending: Set y-axis for stats to zero

Change-Id: I5235d734d37709367c56878fffd3243aaba3f0b8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8e1dfc4ab336302999f91ea0386093b0bc879974)

Report: add gtpu tunnel description to methodology

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Change-Id: I4c066713bb37e35d25b5ab1225a361e05b7a1146
(cherry picked from commit ab095362b4beedbf2b3ec63ec9d277d3f651da0e)

report: update vpp rls notes with trex latency measurement issue for FVL NICs

Change-Id: Ia6de51914f7d31194796538cdd81183c7a16e1d7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b3734284f7cdf49cb04b142c00087c10369a48e7)

Methodology: Update MLRsearch descriptions

Change-Id: Icdcb7210835fa90a6f5f1688b815a6edf07a4b39
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ad8442c642f5dd4a6630e1e66c980cb86c5039bb)

Trending: Add Latency trending

Change-Id: I28c1f1cf113d2537f3e564cdca0fd61ef57737a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2e021b4853ced07e820a933ca9062d9c325a8a7f)

Report: configure rls2106.31

Change-Id: I9d5da2d71525b53096e9c77e9d338243b16f05c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 913ddff5d85c822b8eb974def458a5022246ef53)

FIX: init interfaces for rdma-core driver

We're only initializing interfaces for avf and af_xdp VPP drivers. This
causes issues for the rdma-core driver when the underlying mlnx kernel
driver is not bound. Fix this so that all interfaces are properly bound
to the kernel driver required by rdma-core.

Change-Id: I204309a9bb61b56b96497a287178f0b1efe2f362
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 324f01417f17a5347c102179f3d2277a77b116ce)

RCA: Add CSIT-1789 as a known issue

Change-Id: Ia01eddc69f64d7f4360cda7a612b5b8fae2c41b4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 68f32506b32feddae4f9674a7a32cd3d0ea61fb7)

Report: latency comparison

Change-Id: Ic47209e1911317b6f42a7f8257309607d3a21e04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c9ddd355f7cab79d6a3f337a658f7c377e099661)

Report: Configure 2106.31, fix latency

Change-Id: I6f9e3cc3b79be84acb6b5619016a9aa7d4296e02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7902281ee08456a4d90bb5829ba42da2c71a6379)

Report: Add Latency comparison tables

Change-Id: I6774383eef9839352ed3924e7482177fd85b34e6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f615617a46a21107a9a827a13035997e91bf6d3f)

PAL: Add s3-logs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia8cc2c59a84a61263b2cf88af16f6fd7bad637a8
(cherry picked from commit d102788108352fd5271b139ef3ef1a1c718389a1)

CSIT-1782: 4c AVF tests are failing

+ Implement temporary ugly workaround as I cannot do
  driver upgrade now after discussions with PTL.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I400e3b61bd831b9c9820b1fab8852118f2d48f0e
(cherry picked from commit 9e86d195050fcd75c20d59f78d6f5a5e379a6a86)

Report: Add rls data

Change-Id: I2ad71d35bb2503adbe10cf3e7982e883339a4fee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cf63723c2758fb5561bd1810a2725b1e187f9c1f)

FIX: Executable bit for ansible plugin

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2416a9682710441d098acfff50e943ac3f788500
(cherry picked from commit f7c3f3918646a7bb157e648ed96beb9bb5c232ea)

Report: Add rls data

Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0d9bed4128719f3de748af108dc6259927efde29)

Infra: Terraform add ansible plugin init

+ Manual override

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba
(cherry picked from commit b27f2c7cbfe08712a00959c8cc6a2f618a25b3e7)

Trending: Save latency data in csv files

Change-Id: I397dc1711f52324c158c775522cfef3044724ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a4fe771848907ee4a551cf06432f1ec6da496608)

Report: configure rls2106.30

Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 53e6c3440afd81d1504db75e7fa8d09229641079)

Report: Add af-xdp data

Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e8b47c3df7529a6c087fb7639684f180dad8c03d)

Trending: Add exception handling for anomalies classification

Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1da19da813655f643bc3c6e4d03bed987f076f07)

Report: Add rls data

Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a8d0c4410095c6b87f81bd541ca7ec91e6d62b70)

Report: Add af-xdp

- elements(tput, speed-up)
- static content (tput, speedup)
- data
- Latency

Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c5b94383d2eb8ea33413296a3295759b84915546)

Report: IPsec udir methodology

Update IPsec uni-directional tests methodology.
Remove Deep SPD Policy section as these tests are not in the report.

Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit dea4d7ff2a1b662cde1587b3a8d6c3d832f4920e)

Trending: Add graph with statistics

- x-axis: time [MM-DD]
- y-axis: nr of passed/failed tests
- y-axis: build duration

Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d8fc1521b8def68adc8f4a390aa2d25db806ea4f)

Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If45e592aeade12fe643791b431adc860a745be3d
(cherry picked from commit fe9072ce82a91c5d6de30d07756d5a12b80f9c74)

Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I331fe9134c62594189ca231349ab4c5ba43b51e5
(cherry picked from commit 813375246758d1695be4e577ba9cd3f0791ea9e3)

job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node ThunderX2 testbeds.
- NICs covered: xl710.

Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 44a77d78e272d95e055b6d596c122f4825a9072a)

job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Skylake testbeds.
- NICs covered: x710, xxv710.

Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f5ba2f7100d73e009252782492fef289f2fc4947)

job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Zen2 testbeds.
- NICs covered: x710, xxv710.

Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b9ad36b5f2090a60177d8e38a091dacb7a00e953)

FIX: Testbed driver and firmware versions

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2bb08a3cd7f2138ab98b3c4dacdd1dc46ac8b523
(cherry picked from commit 9479510935a273730ace23481f19706cefbce437)

FIX: Mellanox

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6aba0123c1f79e5c2acbac07503f74fc0050f472
(cherry picked from commit 3725984899ab67d69ad89e5f79d3334ba2fdc780)

job-spec: Fix af-xdp mlr iterative job spec

Change-Id: I012d504309eea97edac7f11bd22935bb8325f988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f71dd880aa5f5cd2ffc5bab83bd9307b17a6af6c)

Report: Add rls data

Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 39957a024d1fff87403aacc34aaaa5a922b6639f)

job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Cascadelake testbeds only.
- NICs covered: x710, xxv710 only.

Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5576796f38aeab2016ed6a01a859f2df6737677c)

Report: Remove missing latency graphs

- they were not generated as the tests failed
- Fixed legend in dpdk comparison tables

Change-Id: Idd57c1702c883d4f6ece470310e823f5885a9bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8c4e9c508d9bf53eb5c6cc8bc531215825c800e1)

Report: Configure rls2106.29, add data

Change-Id: Ib51ee05d67a5a6506367b9f194441be50f360d38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 149b1109affae3e54157e3c38db97f376d27328b)

Report: Add rls data

Change-Id: I013515f98c3aaa4b347d61dd2c815f2ac67d56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8a1e62de051d4952b7e4e3e42f103f3f068d1a6c)

Report: Add per thread resources allocation methodology

Per thread resources include:
- pcores and lcores.
- RxQs.
- TxQs.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 8cd8790583b4d56985c486489327c92e6a9464a0)

report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit d9bb63c2d9f126800f69bd53fca5d42fd2beb739)

Report: Add data, set archiving and pdf version

Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit da7ec9bf7aff31d18325043891aa19cda2b063ec)

Report: Add rls data

Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a47cc2dbd97aee82deebec9bd750d661aaca6942)

Report: Fix links to graphs in hoststack section

Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a841b190f7e448e8c30883e43eb3e6bcecc7788a)

Report: Add rls data

Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ec79cd31fd974372fd6cd02be6a504dff6d50e8e)

Hoststack report content

- Methodology section
- Align dynamic content structure with methodology section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057
(cherry picked from commit c77930b44bd1a35786a4b843bb75a9cbc8741b4b)

job-spec: Add hoststack and vsap

+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh

Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e77fa027ad2a541e53d92743d8477d3aecf944e2)

report: add 2n-icx and 3n-icx testbed documentation

Add:
- Physical testbeds description in Introduction.
  - Add physical topology diagrams.
- VPP pre-release 21.06 version used in Intel labs for CSIT tests.

Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f85930d7b1e3cda191a2e60cbc4e64d93c5fd139)

Report: Add rls data

Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7692bfcfbe9d93a24a3840472fbaccabbefe747c)

Report: Add rls data

Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7ebf93a4ed4f046f3685db87165a75772aa0557e)

PAL: Process sh run from telemetry

Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9789d21f6be4959e9eecc870cf46478960957463)

job_specs: 3n-tsh reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 43f0eca4e9581f26180dfee360554157b56e484f)

job_specs: 3n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7a551264705ea0d069fe18345c90d89b44a59def)

job_specs: 2n-zn2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 58edde117f1c2bd758cb77a6b19fb1e275bcbfe6)

job_specs: 3n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e9786cb012939d822ef1fc5c59e4763fc8cbee42)

job_specs: 2n-tx2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2d994d6853ecf9675152a725333ce7e52eb6ad3a)

job_specs: 2n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9182f99fe55e8009836c77df11cb3e3b58fefacc)

job_specs: 2n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit cd3392cf61fd23b333581dc111fe040fd72de77f)

job_specs: reduce number of report coverage tests for ipsec

Remove:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e75e2f7a9b2fa73718f8a4a5a31fbe56b234f820)

Report: Add rls data

Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 26f1ebf5e85d569018e0a4a1ac188ae59b78b833)

Report: Add rls data

Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3c88629c05256b8f5b1e435a8e94d488eb769224)

job_specs: 2n-clx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 88dd453ccd24b70752c7498b81101a97fc777043)

Report: Publish icx results

Change-Id: Iea22c61f97e62743b4a99b961290a7f722496162
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5af912d1cebf5545c6f7de2bba75d51d828b4554)

Report: Add rls data

Change-Id: I47f36db2b42c3d12c3173fc336fead94fe626abe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a4a74d3a84fff025fcd0fc630a068bd1cac076dc)

Telemetry: Add node info

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I428bf2628f5d6b87d335de415a82d6e94867d8c0
(cherry picked from commit 9b7a1a0ad6dda662fa82dedbeeaf71f7ac625e31)

Docs: DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie7c009d541fbedf7513b7decac9839eb4a98e520
(cherry picked from commit fccc65f1f48d3beb6ce749af4663589fa0484b24)

Docs: Update release notes

- Add AVF issue.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic0830df665de20466c7bd4ab80b3ea597005b4e1
(cherry picked from commit b059d0c7892e8a54010005949ba365f1a68e856e)

Report: Add gtpu tests

Change-Id: I0c48f48a927bb75554f0d9eca4f32f0a3dc30d20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5f1007cce8831017fd2be1f38a6ad023c349019a)

Update VPP_STABLE_VER files to RELEASE version

Change-Id: I0946fdb568a04b69c4779535fd5ea53115567496
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Change Throughput to Tput in graphs titles

Change-Id: Icbd23f4c7339765985f1614debeadf1f4332753a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c3b989790c6367a74fbccfe7b610a5529fe50193)

Report: Implement changes from job-specs

Change-Id: Id9497ae02eb47fed40b9e4c33b98a81c34b71964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6c8ba1c706a4e9e467ab5e2a4b676b9016f9e610)

Report: Add re-test data

Change-Id: Ifa6bc912d4b0dd5c377ebe1654bff694c0c006e7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f975cf2f1e2f5baef0ab0da75a53948d025562a2)

Trendig: Change the priority of data sources

Change-Id: Iee015d717034fd08e86037e5800fbe8231cbd89a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 336e3689671d0c266e7da035c1df978b2404a86b)

Report: Hide re-test data in cmp tbls for tsh, tx2

Change-Id: I7cf8a819f5fbd84882006ec0ca1891b38b2fb58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 578e9a678ebd96789fb63a450336645d6d840afd)

Report: Add rc2 data

Change-Id: I71f1d3957073b5fee66cd38efde003cf19b36396
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1fef0d8079a6a9c2521c7e98a975f4106600410d)

PAL: Process sh-run from telemetry

Change-Id: Ia1a3427609b284d0036dfe3b2ffbb17a9b4f8a65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7b4dc49521908774f9eb2f5d287078cce06d8e49)