Infra: vpp_device -> Ubuntu 20.04

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If24c385b93e1ba310ea258984c97494b4cab467c
(cherry picked from commit f754eac4faf76fdbffac648769c03f5668f9f6a2)

Requirements sync

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ifa0c8a45fbf91753d238d7311583a50a844dcf52
(cherry picked from commit c40f6bc466149571d66e9359bf70646ef3ae7da1)
(cherry picked from commit 230a4b8c3bf7f19aaa7ae69f5bd99d7e13416f30)

Framework: Qemu 4.2 compatibility fix

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I8692b53c02773dbe5a5e02f959dfed8599cb8a4d
(cherry picked from commit 91c3a1da0ddc47dff704bbb54e70f6a0b9af0018)

FIX: LXC image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I73f7a1095b7cee52fade8a31285e405727548394
(cherry picked from commit adf5f13886e8bdd4fb224f12f10d731cadf698f3)
(cherry picked from commit 0488e8a439f13bb2ceee4d1c761f6bf25aeeec45)

FIX: ARM VPP_DEVICE executor

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2a5554884d49ab8063d84c914e447b29d79c676b
(cherry picked from commit 2ccb4c136b4ddffd1fc28a720645d7972947ace3)
(cherry picked from commit 026d128b96a386781733961edbf26ba197530954)

Infra: Upgrade csit-dut image

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0341a1564ba510acf46bda3e24225209abef2f82
(cherry picked from commit 480e1675f3d8e3045265b351681169a1478dbc7d)
(cherry picked from commit 699c4cad1f28b931a637be0bf365d0ab1e08f7d5)
(cherry picked from commit 1026229d60f73dbcc855f9f2499cf26a552bd12b)

Perf: Bump T-Rex to 2.88

+ Mellanox 4.6 is not for Ubuntu 20.04
+ Mellanox for ubuntu 20.04 is 4.9+
+ T-Rex 2.86 is not for Mellanox 4.6+
+ T-Rex for Mellanox 5.2 is 2.88+
==================================
= Bump

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I902dfc2a43e6718b385e89f31a34260e09d61bd3
(cherry picked from commit 6ec31b8aa67f4af2b963b3984f047e94ba790b3d)
(cherry picked from commit aadd201ba28d44660dd86a77dc7248910973cc12)
(cherry picked from commit 9f35c00b6df316585dec0664ad761dced5c2c9e8)

PAL: Remove instalation of system dependencies

Change-Id: I66024f3110804499fa32628b0f72711413d741ac
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b2ab2bc3e5f5a61c45c15f9d5a30da9740f927c5)

PAL: set DEBIAN_FRONTEND=noninteractive in run_report.sh

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I30037a41019ca1071b1dad443a0d09054c09fb3e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb30e6b70823a30f35a1841ff996e2ead2cf0d08)

Infra: Do not strict check keys in Ansible

- not until we migrate to SSH keys in ubuntu 2004

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I796f86922c672ba053d64f317cf6adb46b845cac
(cherry picked from commit 221e2f4da7cb27954525d973d930cb8db4601c8f)

PAL: repeat the download if it fails 2

Change-Id: I9bba50281bfe65f62a1cfab76364d834dc10d80c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b83a029d3c6524b7f0139746fcc4325e692976b6)

PAL: repeat the download if it fails

Change-Id: I0a977009345ca5e46d23cc55405c6fd9b6e61c58
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4d5e0d3bc3e5e58ebc91d52766ab9d146c52ba58)

PAL: Temporary hack until all docker dns will be solved

Change-Id: I8011ae9d6abe5c3eedd7b1519db1fa6aceae5ada
Signed-off-by: Tibor Frank <tifrank@cisco.com>

PAL: Fix: ignore verifying the SSL certificate

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ia39c9fcfc6240a30d48b492ec5e1451d8279c646
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 85785b4fac91e2bc443d4b62b80df418d8a99699)

PAL: Add s3_storage as the data source

Priorities for download:
1. s3_storage
2. logs.fd.io
3. docs.fd.io release
4. docs.fd.io master
5. jenkins

Change-Id: I7114715c3ec9a33acc8edf3c5c473f4eaffa639d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit df0263faee6171805e8bc579a4e0a786e63c3a8d)

FIX: Methodology GSO headers

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I38f8b16ced2c5cfd0ea8b2b0e767f5a73f6a7dd7
(cherry picked from commit bb7e8747d67176367fabadac85bc4e2571a47c93)

Report: Hide 2c and 4c GSO tests

Change-Id: Ifab207f12b056a8c77911ed69590337cea4355af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bab7d6c6056d48df1c1edee30d690ce316aff2cb)

Report: GSO release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I369afd2c90d68078443436402a6224fa42ca646d
(cherry picked from commit 2a5ecb6c130109828210eb7135a8fa4d6a0f2c80)

Methodology: GSO

- Report methodology

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1726af15ab003ff6ee4411ca1ceace986d3ee42b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 1d7a226c6d9b237cdb034e40ededbfcc1094f363)

Job specs: add 2n-tx2 crypto mrr-daily tests

Iteratively increase coverage, but only of mrr-daily tests.

Because of time constraints (i.e. we won't have enough time to run all
of the tests), only add mrr-daily tests and not ndrpdr iterative/cov
tests. For iter tests, add the tests commented out which documents which
tests we're omitting from iter runs compared to mrr-daily.

Change-Id: I35625a1f67004473305cb752a98a962dcb825e16
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 4d7ad95e106c152e90a93b01628324527e5e6497)

job-specs: Fix ipsec scheduler

Change-Id: Ie2b624de84ea193ab744b27ed5eac190a0d5b153
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a152271165987a8a74789c961782260a95f9777b)

Fix: Async scheduler tests are not hw

Suite name part is correct: swasync.
This fixes the tag, from IPSECHW to IPSECSW.

Change-Id: I13a5201dade7edf180d315416c82c15d69c1bfce
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit c2dda6e57c09bf364ee54ae5c81e22fb34c6e0d4)

Add test suites for crypto sw scheduler engine

This patch is to add test suites for vpp plugin crypto_sw_scheduler,
IPsec sync mode is to do crypto and packet forward work in same worker cores,
crypto_sw_scheduler can schedule crypto work to other async crypto cores to
improve whole crypto processing capability.

This test suites configure fixed 1 rx queues per port, then measure IPsec
performance with 1, 2, 3 crypto cores.

This patchset include 1, 2, 4, 8 ipsec tunnels test cases.

+Vratko help to change to count total physical cores instead of previous only
count crypto cores in test cases.

Change-Id: I0e67182e3d13273890a23703d838101900e25126
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: pmikus <pmikus@cisco.com>
(cherry picked from commit f0e964d35af36f0923c6ae0421e74d94022cadba)

Report: Configure rls2101.09

Change-Id: Ib61e7643c2072d9f0e8cdec3bb7e0328bd25d60a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 466ebbe92072c3b525a199b6f6601e8ece82e0d4)

Trending: Fix file names fro nat44 tput graphs

Change-Id: I7e722b268595e8b1de370b3dde9d2b00c566f143
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 572184f5dce9c564ee6fe132e0a22eff7ee75e02)

job-spec: Add test suites for crypto sw scheduler engine

Change-Id: I68af8c56f3bd33d0f122f56f1ae60993beb67969
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0561d043063bec469833a85b09c0875c14cf4d4a)

Trending: Add nat44-tput tests

Change-Id: I0e670cfa4e0125856944656536f0d64d04bdbb6d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0e86d278980b7ebde05047d356bbdd37c13f70d6)

Report: Set .08 revision, fix GSO graphs

Change-Id: I5948dbaf69d183caddbefd16f2198b54a24ff904
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5f0782b8bd0db96a6496d55f44d157146b08de12)

Report: Add gso tests

Change-Id: Ic21d43a104bdafe93600d8f5fd60d403d13285aa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b9aa1c7701f6f261acc4849fb07929c64e3ae692)

FIX: Use x710 for gso tests

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I13892dda60a6e130ebe7c074ac0a3b429e08ef32
(cherry picked from commit 3a2c37ffa4755d89247684935fd27d8868fbfe4b)

FIX: Naming convention compliance

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Idcee623abbc5568fc6ca49113bc2ff8add179046
(cherry picked from commit 1f6797ed6b662130f55d7629453c5010ed94162a)

Performance: Add GSO tests to report execution

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I35b2f786105103f19907d74c4f6cc77d7cd3a5bb
(cherry picked from commit f09a4dffb4b0643a71f3f85960657a02a419ff3b)

Framework: GSO test

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I874568aebbe50c38e634438eb1201ca737bd18ad
(cherry picked from commit ecfe59f83a49e0dda9cead06b81339e4ea545053)

PAPI: Python 3.8 compatibility

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I33fefddda9055524c1817b13b5c99bb1b97ebff4
(cherry picked from commit 96c5f5ef45cf039691404a4451b1c6d9260d6ea0)

Report: Add data

Change-Id: Idf8610d4502a3e0ff0ff0471c1fe6a75cd46a593
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bb982ded24c87f3cbc2f84e41d85e426cd9092a4)

report: fixed typo AMD 2n-tx2 to Arm

Change-Id: I8b5af0a2a8b7af287e0258f0465687f3574c1ead
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 6e9cac0ad9f995c865a0f570a64ca19ce4030ab4)

RCA: Link to NAT44ed performance regression bug

Change-Id: Iec30c261225d99acec5a12bcda9ffe1809eed251
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 059ccad48e2ba56ef1922e54df01d6ba0cd5daa2)

Report: Add data

Change-Id: If25bfb368aebc6ac84062086f81f67a62b30c912
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2ba4a54e5af01393d6ca8a73d64644bcbb07f9a1)

Report: Add comp tables for 2n-clx with mellanox NIC

Change-Id: I64f1821877f749cfb44b886b4760faba577a2014
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6b7f5d26098ba3a76b16169865eaee273274e96a)

Report: Add framework speedup to notes

Change-Id: If01c977a48bb64c53608f6b937a715fc11000446
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 05c22cea868503479b92236f2be6debe98e96c95)

Release notes: Tput tests and jumbo ipsec

+ Also randomized profiles.

Change-Id: I8eefedca65129d8ebbd6f08b68e5884c930b1dc4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Report: Add 2n-clx cx556a Latency graphs

Change-Id: I026ebb96874c55059e230d6e4db2424c341c04c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7a3ffd6d385159609fe9ee8b8c575aa4fa4d891a)

Report: Fix spec for Latency by percentile: 2n-clx MLX

Change-Id: Ic782ef76d35b3349a04f57578c070b2f49e4ca7f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d3f4273f0be2eec74eb1a2bed6d1f06ee5f3459)

Report: re-group RND tests

Change-Id: If45709086b850b6cccc44645ab195fd77296e5e3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1c32c469514179f2a77ad2049c5e6ebf1c30bea8)

Methodology: Added packet flow ordering

Change-Id: If0f0397c2ace9112490e017ec8d18cfbf1dffbc5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 26328f390e81f7bcfd536fb7faabaa224d82f857)

Report: Add data

Change-Id: Ia5c7e127c0063c4c1c8d265936361a68c4646f04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 42a4834d143fe480d70aaed3c1ebb9eb9681d53e)

Job specs: Add -tput tests to iterative

- Not touching coverage yet.
+ Trending stuff should be handled already by symlinks.
+ Adding to anywhere with -pps tests.
+ Only nat44ed version.
 + Because ip4base is stateless.
 + So -tput will have the same behavior and results as -pps.
+ Test counts and run duration estimates updated.

Change-Id: I4e7ce7e9974c995ccf0a21300fa041031ca81cfc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit df0c31ceb15da3542f15941e1569e471d0f22007)

Report: Add 2n-clx Mellanox tests and graphs

Change-Id: Ib947d47b31138ac816acefee03429d454511dd05
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 87cd7f3983eade6f27a848b23409c95e4a35b631)

Report: vpp device i40e known issue

Add the i40e PF/VF race condition known issue to the known issues list.

Change-Id: I1eb4dcea118036dec3f3715f0d08d124f2a9ad1c
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit a0775ecebbef2caa05ae2ad1e0b666f178acfc02)

Report: Add data

Change-Id: I6803f9694c0260817d93258b4cb99cdd47dea9ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1aebe29b8da1fc1ce77cbdda8da410b18fef74c0)

Methodology: Add NAT44ed tput tests

Change-Id: I22a38ca98cb0aa4bac9a03d3943e807c26ce4474
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 24012f71b90d48dbaab941a8815427bbf54ba5c1)

Report: Small fixes

Change-Id: I30c51b2fb71322df042d76394dfa223615f2d206
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 72f18772740b0dde1ed6e44d740f8456ce0546e9)

Report: Update release note section

- Infra update
- Cleanup

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib8fe70fdbbaeabfbb9f2e96fc8a9ab87a8e63f35
(cherry picked from commit 60b531215d36e2402b1b6c768bd4fd4d4b210fd0)

Report: Add data

Change-Id: Id7f398a3d4080d3780ac9684ae2e925d7eb59c86
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d56509e3e8e1109e75362fe7c2bf1f4fa805efed)

Report: Hide nat44 tput tests

Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cf2a4f97f261a8ab27578232e9f419968e8a1fb1)

Report: Add latency graphs for NAT44 tput tests

Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d517fd2f0363ef4b0d857f8a4437fb0a39d7d144)

Report: Add NAT44 tput tests

Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ddaf1688aa8dbb6f9a6e463faaf62c752c53a394)

FIX: Nic selection

- Buggy unnoticed for quite some time

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa
(cherry picked from commit 127eb76dfeca04e123b0d7cc229c4a71ee3f2f9a)

Latency graphs: Do not hardcode x range

+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.

Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 7c0d519483e2c5e5a0c9997ed01408200b64370b)

Traffic generator: Force ramp-up in next test

The behavior was already documented, just not implemented properly.

Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 28ed095b73c4a01ed73c93b3b80da22a4bcca907)

job-spec: fix report_coverage/2n-tx2/l2-04.md

- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
  eth-l2bdbasemaclrn-macip-iacl50sl-10kflows

Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2925ed78ef21456cf6f8dfbe4afed6ea0307ed20)

report: add 2n-tx2 phy testbed diagram and update description

Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b6cac504fa90b85b94317238082885759ca28348)

Report: Add data

Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e61e873dd9252b6824cbc3c37bafccf85813a7a1)

Report: Add data

Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 15c18ac54d1794da1a9a4a1c12e10a46426e8a65)

Report: Various fixes

Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5cbe9912f188bcad4956b212dfed12af5dccf065)

NAT44ed: Add pure throuhput bidir tests

+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
 + Correct computation of next duration.
 + Checking both early and late sessions.
 + No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
  as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
 - Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.

Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b26fe6de7965f6621b54a80a938f82afe95aa585)

Report: Set range of x-axis for latency graphs, add data

Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0c02e000ae58474120246c484cf5458a76510288)

Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 340c20a3f3908d832ad093349e1ccb14060e8035)

Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f60c0957d9d66a19a05c06e27839401f7ec97829)

Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 879b31f02fb4df52016d7465e21377121dfbb515)

Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eecc9da92caae82e9e9a608c41fd0b192780fe4c)

Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2e769b838081d49868ea793f8c38318f5a1a6cef)

Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 29ce700b9cf1a6b275f13fc3975991289b062e53)

Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit df3b53935c5db2e53cf8e72ca2ef5be995071e69)

Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 38b98cea69a149ac5b1be23f0dbad79e7e1cb01c)

Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b5073afc4a941ea33ce874e016fe86384ae7a60d)

Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9387a7bd3187faa7c1e75daa084bda5564c74d94)

Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 50a4e5e45f5e6e18f2dac6aee69adb85ef4d12c4)

Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 45423631acb4ddc58f20fffa096b46724de75ee8)

Report: Add data

Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b4cc5ae04a3cefa5e4a3b6819003c223299b61b2)

Add suites with randomized ip6 profiles

+ Replace pair of traffic profiles (2n and 3n) with single nodeless one.
+ Compared to incremental suites, randomized ones add IP6_RND tag.

Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ad98ea70cf435d104b6a4f0090575e137660da77)

Report: Synchronize report spec with master

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Iaaa64ad82319a8176bf25693815136851925d38b

Report: Add 2101.release data

Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1a82cf21d8ec419543fd46bbce3d64528fbb6bb4)

Fix: Slack API key

- Clearly we must implement key storage vault to avoid storing key in
.tfstate

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7
(cherry picked from commit 101d3251d3f30f894a9143f8c1062761f3ed8337)
(cherry picked from commit 6b4b75acf819a8a7c68d0f57365bbd6e0b4d3933)

Fix: Slack key workaround

- Todo: Deploy hashi vault.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad
(cherry picked from commit 993696b15c5f5b63c5d206fd9cc9b32c4af4e2dd)
(cherry picked from commit 3715b48d91e15d0f961963acb641abce67a101d1)

Infra: Monitoring capability

+ Monitoring SOA
  + Nomad alertmanager job
  + Nomad prometheus job
  + Nomad grafana job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2
(cherry picked from commit a44eef233de959c5679602dc6cd1ed866d6abc14)
(cherry picked from commit 2856c0a0c19319de146a93c27e106351faf1926c)
(cherry picked from commit 6717a3bc8b5fb81c1a19964fd367878230331457)

Infra: Remove Consul TLS on clients (Nomad conflict)

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf
(cherry picked from commit 474163bc78aa418595b227c81056987b1114104d)
(cherry picked from commit dae934efdf9c773b90cc4a9595d217dd55035561)
(cherry picked from commit ba5dcdbecd4c009c832c2a186a58566a5ef4dc81)

Infra: Remove unwanted terraform output

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a
(cherry picked from commit 6cc6235c7a693d7d4c22bb8a067924372bad6faf)
(cherry picked from commit 95a7a55f4b7f77a1af8ddd8a8088896b7c8bcae5)

Infra: Terraform vpp_device module

+ Convert to module
+ Fix memory limit

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c
(cherry picked from commit 2afd8f4fe26ae1f1d183ecac8f9daa85f68bc634)
(cherry picked from commit 7c90b6a0f1d0e14f64364d0213e473d447980d05)
(cherry picked from commit 7a760c915e1d905f6cc0b2ef99ad293e3e5e290d)

Infra: Adjust vpp_device x86 memory layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10
(cherry picked from commit f6882e6231ef0a39d137862d1fb5b75f8eddd9c4)
(cherry picked from commit d04cbd87772bf94648f130ce356ad53406760485)
(cherry picked from commit 66946b2e17f15f09f03f2c1e646aa8fc844d614b)

Infra: Align Nomad settings across cluster

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66
(cherry picked from commit d69b5158e2c4ef0bae7acb1f99c103607a4d7b2a)
(cherry picked from commit 45cb36933587e92ceb901725134d0eaeece82104)
(cherry picked from commit db5da5b55359cf824ca1a06371622d9094d9cebc)

rls2101: Update VPP_STABLE_VER files to release version

Change-Id: I1b4ceae9027f2d439c29058f4a19f0a28a698c0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

job-specs: Add rnd tests

Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3354bdb7f7c183322c886ab1c89c8f3bbf42366b)

Report: Add data

Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6615bce0d5ac4cb88bbeec584fa7094a6db2c06)

Report: Fix reconfig graphs

Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3f8cd3759d371a5ac2df46cfb981cc3a599574ea)

Report: Improve reconf graphs

Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d7ec5e661abec4dda2546843addf1a71580e97e)

Trending: Add GENEVE tests

Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5e996684dd0c95089256631c696e4fb9e72e21a2)

Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1e3c01e0e458d62ed228e8d6a916c24992304252)

rls2101: Update VPP_STABLE_VER files

Change-Id: I4db975fab589594f7551217b64adfe13cf628f65
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 88bbb1908b4aa58163374c983b4b8e85e78460d5)