Report: Hide nat44 tput tests

Change-Id: Ia01a4a7b0b70547655ab9c6e463040bc97f1727f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cf2a4f97f261a8ab27578232e9f419968e8a1fb1)

Report: Add latency graphs for NAT44 tput tests

Change-Id: I296b7fdd99daa8ac2692843dbf8a73ab98b8c1ff
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d517fd2f0363ef4b0d857f8a4437fb0a39d7d144)

Report: Add NAT44 tput tests

Change-Id: Ie5a92818db14ccacb61ac126e75aa14e114eadc7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ddaf1688aa8dbb6f9a6e463faaf62c752c53a394)

FIX: Nic selection

- Buggy unnoticed for quite some time

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d2387186e0250b80d664e2f004f909fd80c7bfa
(cherry picked from commit 127eb76dfeca04e123b0d7cc229c4a71ee3f2f9a)

Latency graphs: Do not hardcode x range

+ Compute it from PERCENTILE_MAX.
+ Use slightly higher PERCENTILE_MAX to avoid rounding errors.
+ Add a comment why slightly higher value is needed.

Change-Id: Ic54378d94568efbb8c78a889424f931591ef42db
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 7c0d519483e2c5e5a0c9997ed01408200b64370b)

Traffic generator: Force ramp-up in next test

The behavior was already documented, just not implemented properly.

Change-Id: Ib8c232c004e91032e1230e86dda9f70bdfab43ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 28ed095b73c4a01ed73c93b3b80da22a4bcca907)

job-spec: fix report_coverage/2n-tx2/l2-04.md

- replace eth-l2bdbasemaclrn-macip-iacl1sl-10kflows by
  eth-l2bdbasemaclrn-macip-iacl50sl-10kflows

Change-Id: Ieaaea1e59533059ceaffe1e3c767d51b4ab7c8d0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2925ed78ef21456cf6f8dfbe4afed6ea0307ed20)

report: add 2n-tx2 phy testbed diagram and update description

Change-Id: Ibd935b2f81c266037711b31d7b76384133b9d45f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b6cac504fa90b85b94317238082885759ca28348)

Report: Add data

Change-Id: I578755b72bc2a4ef310b9c14193de2f995803453
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e61e873dd9252b6824cbc3c37bafccf85813a7a1)

Report: Add data

Change-Id: I10953162634f21b3f2952fca3abded2c12e397c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 15c18ac54d1794da1a9a4a1c12e10a46426e8a65)

Report: Various fixes

Change-Id: Ib3fcf5b9a839ce397970761c717310da9c8a63b7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5cbe9912f188bcad4956b212dfed12af5dccf065)

NAT44ed: Add pure throuhput bidir tests

+ With ramp-up, without reset, with session verification.
+ Uses the same profile as pps tests.
+ Ramp up duration is not specified, as duration is computed.
+ Timeout tracking with automated ramp-up.
 + Correct computation of next duration.
 + Checking both early and late sessions.
 + No loss measurement also acts as a ramp-up.
+ Return ReceiveRateMeasurement from send_traffic_on_tg_internal,
  as that is needed for detecting whether trial is ok as ramp up.
- Udp needs quite low ramp-up rate after recent regression.
 - Max scale has higher rate (so failing) to avoid session timeouts.
+ Bump copyright year.

Change-Id: I50c928659cd5b985b490a2e5fb69c5cd790600b0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b26fe6de7965f6621b54a80a938f82afe95aa585)

Report: Set range of x-axis for latency graphs, add data

Change-Id: Ibfa1d6d0fb851b8c2d55c0cc749307efb36a5a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0c02e000ae58474120246c484cf5458a76510288)

Trending: RND tests

Change-Id: Iafd66841e81898e4d835b9ebabb1496c170e7ff4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 340c20a3f3908d832ad093349e1ccb14060e8035)

Report: Add data

Change-Id: I26eaa7c336d3873cc33a7be5e2ee4da7e8f50603
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f60c0957d9d66a19a05c06e27839401f7ec97829)

Report: Set the range of x-axis fro Latency graphs

Change-Id: I2807dc920805c8a59a97ddbd92ad17e4372826db
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 879b31f02fb4df52016d7465e21377121dfbb515)

Report: Add 2n-clx rnd latency graphs

Change-Id: I7c8c6d2129cc67a7a9f635f0b6ebea53ffa6e158
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eecc9da92caae82e9e9a608c41fd0b192780fe4c)

Report: Add data

Change-Id: I9a09d6077f0c3acbd42b79220aec69dcd9490359
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2e769b838081d49868ea793f8c38318f5a1a6cef)

Report: Add data

Change-Id: I5243c2b2a9669df4bc57f4d606b4bf0df3d9580c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 29ce700b9cf1a6b275f13fc3975991289b062e53)

Report: Latency graphs

Change-Id: I5ca267827a549f7378c289e7db1d3bb89f5482eb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit df3b53935c5db2e53cf8e72ca2ef5be995071e69)

Trending: Add IPv4 and IPv6 rnd tests

Change-Id: Ie90b88466575c33c2c45e8fb9c2b0c42dc795aa6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 38b98cea69a149ac5b1be23f0dbad79e7e1cb01c)

Report: Add RND Latency graphs, add data

Change-Id: I9882b19a87e0d7437471ac5e5f7986d69fe2ce34
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b5073afc4a941ea33ce874e016fe86384ae7a60d)

Report: Fix spec

Change-Id: I2c7e98c05543e878a6a220fe8d4ffbb15eaa1997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9387a7bd3187faa7c1e75daa084bda5564c74d94)

Report: Add RND tests

Change-Id: I43289d4dde371984698b0d1a16e8dd65fc33f84e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 50a4e5e45f5e6e18f2dac6aee69adb85ef4d12c4)

Trending: Fix nat44 tests in NDRPDR trending

Change-Id: Iab49c4e55d4cb3ad1e1c5399a406de6e9e8fbed1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 45423631acb4ddc58f20fffa096b46724de75ee8)

Report: Add data

Change-Id: I97bdba256d5886c0ffdd42d4427038bd3b443043
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b4cc5ae04a3cefa5e4a3b6819003c223299b61b2)

Add suites with randomized ip6 profiles

+ Replace pair of traffic profiles (2n and 3n) with single nodeless one.
+ Compared to incremental suites, randomized ones add IP6_RND tag.

Change-Id: I2f0dfc9e04bbcd0f88e95b92edf2da2c73faaab6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ad98ea70cf435d104b6a4f0090575e137660da77)

Report: Synchronize report spec with master

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Iaaa64ad82319a8176bf25693815136851925d38b

Report: Add 2101.release data

Change-Id: Ic4587cb7f6fb5f2ee3d70169ad03d02d1721bd62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1a82cf21d8ec419543fd46bbce3d64528fbb6bb4)

Fix: Slack API key

- Clearly we must implement key storage vault to avoid storing key in
.tfstate

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Iea2db10e4cd59c29a0c74ee92cbddc7d261bd6a7
(cherry picked from commit 101d3251d3f30f894a9143f8c1062761f3ed8337)
(cherry picked from commit 6b4b75acf819a8a7c68d0f57365bbd6e0b4d3933)

Fix: Slack key workaround

- Todo: Deploy hashi vault.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib02f00039bd4cbb4725ea3fec56184b7928208ad
(cherry picked from commit 993696b15c5f5b63c5d206fd9cc9b32c4af4e2dd)
(cherry picked from commit 3715b48d91e15d0f961963acb641abce67a101d1)

Infra: Monitoring capability

+ Monitoring SOA
  + Nomad alertmanager job
  + Nomad prometheus job
  + Nomad grafana job

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I0b32e9c87276ba1a2d4a5322816f3473c737eae2
(cherry picked from commit a44eef233de959c5679602dc6cd1ed866d6abc14)
(cherry picked from commit 2856c0a0c19319de146a93c27e106351faf1926c)
(cherry picked from commit 6717a3bc8b5fb81c1a19964fd367878230331457)

Infra: Remove Consul TLS on clients (Nomad conflict)

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7c825150a19dd783a255fcc5cbd31b91c6b0b2cf
(cherry picked from commit 474163bc78aa418595b227c81056987b1114104d)
(cherry picked from commit dae934efdf9c773b90cc4a9595d217dd55035561)
(cherry picked from commit ba5dcdbecd4c009c832c2a186a58566a5ef4dc81)

Infra: Remove unwanted terraform output

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id6ed065d05c20b6305abfecb8e79bacb86c5b85a
(cherry picked from commit 6cc6235c7a693d7d4c22bb8a067924372bad6faf)
(cherry picked from commit 95a7a55f4b7f77a1af8ddd8a8088896b7c8bcae5)

Infra: Terraform vpp_device module

+ Convert to module
+ Fix memory limit

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I95285faabbf7bad7fcb7f3b0c9b4e79641c6b95c
(cherry picked from commit 2afd8f4fe26ae1f1d183ecac8f9daa85f68bc634)
(cherry picked from commit 7c90b6a0f1d0e14f64364d0213e473d447980d05)
(cherry picked from commit 7a760c915e1d905f6cc0b2ef99ad293e3e5e290d)

Infra: Adjust vpp_device x86 memory layout

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I43b3b891b270903419b7fcf132813563306b6e10
(cherry picked from commit f6882e6231ef0a39d137862d1fb5b75f8eddd9c4)
(cherry picked from commit d04cbd87772bf94648f130ce356ad53406760485)
(cherry picked from commit 66946b2e17f15f09f03f2c1e646aa8fc844d614b)

Infra: Align Nomad settings across cluster

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Id362e47ecee9fd4eac8332978d81f33656880d66
(cherry picked from commit d69b5158e2c4ef0bae7acb1f99c103607a4d7b2a)
(cherry picked from commit 45cb36933587e92ceb901725134d0eaeece82104)
(cherry picked from commit db5da5b55359cf824ca1a06371622d9094d9cebc)

rls2101: Update VPP_STABLE_VER files to release version

Change-Id: I1b4ceae9027f2d439c29058f4a19f0a28a698c0d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

job-specs: Add rnd tests

Change-Id: I877f46608853401c5226845737ace691e3f393b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3354bdb7f7c183322c886ab1c89c8f3bbf42366b)

Report: Add data

Change-Id: Ie90bdf03bb4190e199bfdcb440125caea7bfdef8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d6615bce0d5ac4cb88bbeec584fa7094a6db2c06)

Report: Fix reconfig graphs

Change-Id: Id8d4930937e502bd8b4b54145437a9e7f668ace5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3f8cd3759d371a5ac2df46cfb981cc3a599574ea)

Report: Improve reconf graphs

Change-Id: Ic935c946123c4dcc9daa608c523767b9aca36ef3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7d7ec5e661abec4dda2546843addf1a71580e97e)

Trending: Add GENEVE tests

Change-Id: I5e20f6351dd3854eef075e1bf954dab5aee61698
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5e996684dd0c95089256631c696e4fb9e72e21a2)

Report: Add GENEVE tests

Change-Id: Ic6ede53c94c47159d0fde658e2eef309b9d39371
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1e3c01e0e458d62ed228e8d6a916c24992304252)

rls2101: Update VPP_STABLE_VER files

Change-Id: I4db975fab589594f7551217b64adfe13cf628f65
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I234b42fa5a402a27d210da9ebc247ca5291d1877
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 88bbb1908b4aa58163374c983b4b8e85e78460d5)

Hdrh latency graphs: Do not skip the last value

Linear x axis does not need any skipping.
For logarithmic axis, descrease from 100% to avoid infinity.
Currently using a fixed PERCENTILE_MAX value.
Added a comment on when to change that value.

Change-Id: Ic10a19532455e597272efdb4542e43d09ce49d5c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit d4f12e6931c7fdf84043d8fb2f71e2f38965f26b)

Report: add geneve to perf release notes

Change-Id: I0473bda59edf874119a474fb2e84177e19f58d02
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 67d3b2a44d49dd2c4a1b2f722849f57432787137)

Report: Add data

Change-Id: I1d5031780b1bef169509058233e02624d7afecb7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0c489b1767a031837f320c1fb5e45947ac82ea4d)

Report: vpp-device release notes

Change-Id: Ieacb9e4fac471cbe5cd28288341695352426c134
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 7b9b65a3af83267a4e6a36fc98996aaa05060a87)

Reconf: Fix bidir/unidir mismatch

Results if NDR search is in TPS (so unidir) since
https://gerrit.fd.io/r/c/csit/+/28208

The bug was causing all reconf tests report zero loss,
as they used half of NDR load during reconfiguration.

+ Small improvements to descriptions of other traffic keywords.

Change-Id: Ib9af5861cc09e698eb762feb3f0a019571d17962
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 293a88b56179094f655178b838b84844a672390d)

Trending: Fix bugs in 2n-tx2

Change-Id: I5522e2cb37b9e319bfde009297525179da2e50f7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7f7f2fd7363637d0da626a28bb8a0b357d314a9d)

Report: Add data

Change-Id: I09a695d9c747d4bb6826d27283ab0aa172fc0d30
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9e08f1dfb125d092a48f92c764f52ae97f8a9995)

Trending: Add 2n-tx2

Change-Id: Id2d0248128eee6a5b0969c7f27aae946ed47bbaa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3fc6ce9f08f0a1c1293dfc032fdddfe5e3f7eb16)

acl: add L2BD dev tests

Signed-off-by: Martin Balaz <martin.balaz@pantheon.tech>
Change-Id: I70127d8dd2241b70511f31842eb8a9e3cbafdc4b
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 0f3baca2366f969de6b5d3b889c1b05f72995ec2)

job_specs: add geneve tests

Geneve tests added to report_iterative and report_coverage job
specifications.

- tests with 1024 geneve tunnels added only to report_coverage jobs
  until fast PAPI is finished

Change-Id: I11a12d3c626dd2daf6287440131795daa7f75e48
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 3d0d137bf45e1cd3c7aa06480f5ea08175a6df01)

Tox: Improve tox.ini

Just stylistic improvements, no functional change.

+ Use "ignore_outcome = true" instead of "|| true".
+ Document and apply recommended ordering within testenv definition.
+ Fix some typos.

Change-Id: I004f12fbdf6dbeb555daa7cd111938b7eeef20b3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 52a39f861bb645831130ef109a14e629be9bde7a)

Report: Add data

Change-Id: Ie7450076891e1041b5635f8ea714f94909b6d407
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 216c68cc8b010642c4de21673b7d8e18006767e2)

Report: Add ip6 latency graphs

Change-Id: Ic53214b0a0360bdb6d62d100fc7b9c8e15fb8397
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5e0fe5a28969dfc9fe36415a065122a668d5a273)

Report: Add data, 2n-tx2 latency graphs

Change-Id: Idd9396c0f260355e3b7b90839bd4b1f64d8b0644
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4bc1e70ad02b198a7b9ea32b72da3ae98978e8c5)

Job specs: Add some ipsec reconf to iterative

We now have more time for 3n-hsw testbeds.
Added only scales of 4, 1000 and 60000 tunnels.

Change-Id: I283a816e1440a9fe1f0dea13f954f92b457ea788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit be5833232791a24921e7e9695e53efcbd7ff248e)

Report: Add data

Change-Id: I1b7314affd08d12b67212affb2ef89f64d1347ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f5863d6213bf0066b9647a7dde10d56bd7260f80)

Random flows: Use seeds again and increase limit.

TRex does mix seeds when distributing over workers,
but it is multiplicative [0], so zero is the only bad value.

Limit restricts the cycle length of PRNG (by resetting [1] the seed).
We want the cycle as long as possible.

[0] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L1616
[1] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.73/src/stx/stl/trex_stl_stream_vm.h#L313-L314

Change-Id: I33a29496f0853ef60d592c988f81a9d1109b5878
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit eedb7dff222d2590ac2cb5a5e67dc7d90317f05c)

2101: Update VPP_STABLE_VER_ files

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ica196e6a309e4dc2fdfb51b7faed72a627311991

Report: Remove slider for Latency graphs

Change-Id: I86b9af8e2ebbf27cd8d93c9a04901dce874fa9d6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 69264aed8d43f3c4a8342dd7584f80336108c879)

Report: Fix specification

Change-Id: Ida7035fd130f566215f222d9cd7e98beb583af94
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4d04d11497eb87f94d6ac4982e4b17ae0f48d811)

job-specs: Fix hoststack

Change-Id: I1e450ec00621c7d0bd5a2fd91491c31eae3481f4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e4d7b3b4d4185e97443830e7e9fb0f570031a376)

Report: Add data, add 2n-tx2

Change-Id: Ic2f8e03c16c432479139648cad7982a962193bc4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit caef25a1412689fc0906e024e9b26c547ecfc5bd)

Report: add 2n-tx2 static content

Change-Id: I476ac52d64999f6d3ca3ee726f018f36693ac921
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7f0abbb8f56342fc09b09beb47661f4d55b7eb62)

PAL: Improve latency graphs

Previously, they used sloped lines connecting reported points.
But HdrHistogram reports only the upper bound of percentile.
Example: If all samples are 10us,
HdrHistogram reports a single value at 100%.

This change attempts to show the whole intervals (0%-100% for the example)
as a series (vertically connected) of horizontal lines.
Hover also shows percentiles as intervals.

Change-Id: Id7bbff7b1c29d7f62472041340fde88903363cfa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 826d80373dbd20bc1feac2403e9cade9e5633336)

Add 3n ip4-rnd tests

+ Rename traffic profiles to avoid mentioning number of nodes.
+ Improve 2n rnd suite documentation slightly.

This is a manual cherry-pick of https://gerrit.fd.io/r/c/csit/+/27679

Change-Id: I82d6fb6a99133163a58d56f2acf8a7b9568ee77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

License: Update block replacer

... so it replaces also long (older) form of GPL license.
This way replacing to apache and back ensures GPL has (newer) short form.

Change-Id: I34efd83a91e54b2b2bbb3c4429d1b82397a1e8f8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 193fc1732fdacf424d36bbb979037ba261457cb4)

License: Wrap GPL block to 80 characters

The original license block was adapted from
https://wiki.fd.io/view/TSC/Proposed_Header_Python_Test_Scripts
resulting in a line longer than 80 chars,
but those are reported (although not blocked) by tox verify job.

As the text from wiki was not used in verbatim
(it uses c-style comment block),
minor formatting change like this should not be a big deal.

+ Bump copyright year.

Change-Id: I55e3a0232639b448b1a6d7b1f3af84d903a8d0a5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 624e580159dc056035d7e962582e86a000f8c3d6)

perf: GENEVE tunnel test, l3 mode

Jira: CSIT-1768

Change-Id: I888ae1a5754fa07297d4cdf65c2be0e3e49d89a5
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit 6962831a1f1905e50a3d663c0cf3ce8c2873ecc9)

Change-Id: I6496ae773b176b2abfedab843110d6f870c62888
Signed-off-by: Jan Gelety <jgelety@cisco.com>

2101: Update the stable ver files to rc2

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: Ibec19f45e307af8b6c92d76ed0da126650973c3b

Report: Add data

Change-Id: I3ac0e892ef3f2b0a23b42465565d28f5d5027dae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ef5c30213bb28824a55f4ebbcade6410ee8d2461)

job_specs: fix 2n-tx2 ip6 iacldst job specs

Change-Id: Id0f74dd289a05c84f6f0723adcd678f02c7464fa
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 55eb33d7469ec635755d0942c74ff798f9f3d498)

Report: Fix plots

Change-Id: I70a7929400d7fba144a3669fc9d8aff003695f55
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 81958d4bc5ec4803be0726d94564680e2a0f9a5c)

job_specs: update 2n-tx2 coverage specs

Start out with l2, l3, classifier and acl tests.

Change-Id: I8fc390c77e410e4f4832b4412114253dd34a5fbb
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>

Report: Add data

Change-Id: Ia6f46cd9dbf83e6376f635b3e250708bdfba80be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 98a94315dae63bd19c7bc16ce50b3219386aa34c)

Report: Add data

Change-Id: I23dd384edd107facdc8e54275c1acded5a9935fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7a26d43c4f71869695ba19ce58f9afac9a1d176d)

Report: Add data

Change-Id: I70153753ccc69597dc2c69133b3828cd76174468
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1899cf849e938512df8bac9ea7cb6479732dda42)

Add 2n-tx2 job specs

Change-Id: I992c1466b2226337a043b46e1bdba82de2dc2368
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Report: Add data

Change-Id: I648732e98941b562c31a9db735332bd215d65870
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1b141f8090e9b067dce9d182a81aa530213d4a66)

tests: add 2n1l l2 acl tests, update 2n-tx2 specs

Modify initialize L2BD ACL keywords to be usable for both 2-node and
3-node topologies and update testsuites accordingly.
Add the missing macip T-rex profile.
Add classifier tests to 2n-tx2 job specs.

Change-Id: I17b84b8fc18ef9a6f275ae0238a0665ac2017f01
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 9d510d595f73d26e3f7c6646fa6530e8f252f790)

Infra: Increase shm-size

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ib9dfb8623757fd23fd8b49b5e04ed86e202ada66
(cherry picked from commit 2f4b14bc83437afcc242190a121ba47a6d10bd09)

Report: Fix plot layout

Change-Id: Ia2c448a6b9bed2095710c04fde606649385e408e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fa0e6315e4db3d96b281fb7467a9416150c0bc9f)

Report: Add data

Change-Id: Ic584b2340bbaebf5699213358292159518546334
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e7c71f5e3de89d0e9f0b6d5d0ee099e1ee97c2db)

FIX: Backward compatibility include selection

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ieff60a44d42d66acee8ba1680e7e285d6cd01bc9
(cherry picked from commit e62ade12b7c9918cda2d363387ed0f517aa9840d)

Report: Add Latency graphs with logaritmic x-axis

Change-Id: Ic41b8761aed4256cb3f8ab9d14831e9d2be1598c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b370b24ad548c2caba20fcfd1c4796416d829c7a)

Report: Configuration

Change-Id: Ia1d95d610ede86127797eecd89eb68091d15d54c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5dd28c508cf6f04dee46580c73272c2cb31f5831)

Report: Configure report

Change-Id: I1c64758f937c34a8f3956a5aa6512bb16a9dfe62
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit fc3f7fa58880d2327c3364bbcf8338d2256fb8f0)

PAPI: Cache connected client instances

Disconnect+connect cycle is expensive and slow.
This change tracks connected client instances
so later "connect" to the same target uses it.

Explicit disconnects are allowed (and executed before VPP ends),
but once again disconnected instances are cached and reused,
as creating a new instance is more expensive than just connect.

+ Add missing checks on interfaces being up to appropriate keyword.
 + Use appropriate keywords.
 + Add a comment explaining why a simpler keyword is not appropriate.
+ Improve VPP checks in containers.
 + Fix the vppctl check to actually work.
 + Add PAPI check to ensure VPP is really ready.
 + Delay/reorder checks to make them faster with multiple containers.
 + Leave some TODOs to improve various lifecycles later.
+ As we do not stop VPP in test/suite teardown:
 + One final disconnect is needed, added to __init__.robot teardowns.
 - Import of the final disconnect keyword is ugly, but it works.
- We could use a hashable class for distinguishing node+socket pairs.
- Are we connecting to VPP inside VMs?

Change-Id: I49cd726740c3e8cae1591c7c84b85a447241228f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit a33b52ae0f255021d89307ebc694f6e907906151)

Set DPDK version to 20.11

Change-Id: I6f95ad79c891def175dcbc778d26ced0ec84f799
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4e2347f3996290fbc2386938791c2f272d052c63)

Infra: Ansible sync

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ida73c8acab94ad334fe57bb52f4dab33c40dded6

fix: geneve

Change-Id: I23541e1c07a42b4baa560c343ffeed3b963fe694
Signed-off-by: Jan Gelety <jgelety@cisco.com>
(cherry picked from commit d7a3262b58c86868a18c29244f29196203e1eb39)

API: deprecated COP APIs

Signed-off-by: Tomas Alexy <tomas.alexy@pantheon.tech>
Change-Id: Ifb97088a26f3c2ab2ecee28ed43e6e957a844c64
(cherry picked from commit 9446b9bf9c15999feec3c8a48fec428bca094500)

GSO: TAP/VHOST use case

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ibafaaca4438587284d1e255c764f0701002941e8
(cherry picked from commit 44dcb3113c8ade2e44543746abca861a89362c9b)

2101: Update of VPP_STABLE_VER files

 - use new vpp ref build - ubuntu 18.04:
   21.01-rc1~3-gf097300c2

 - use new vpp ref build - centos8:
   21.01-rc1~3_gf097300c2~b6

Signed-off-by: Tibor Frank <tifrank@cisco.com>
Change-Id: I3c3d62cf1dcfab38075387c496b6849d790f53b1

FIX: AWK NIC replace in case of x520

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I7d83ba048e0609d6b8623fab5c2960e48a37c023
(cherry picked from commit 3c3930b9f6f9a40d6b30f6e56e8c40279e34f650)