feat(jobspec): Add new new ipsec with UDP encap

+ Only for dpdk-plugin and primary NIC.
 + Prefer Intel, as that seems to have more stable performance.
+ Only one testcase per suite: 1518B 1c.
+ Add full set of 10k AES256GCM tests where not present already.
+ Remove multi-core ipsec AVF tests from 3n-icx to keep duration small.
 - Performance of those was limited by CSIT-1948 anyway.

Change-Id: I9166f15b44071dafe89ac8ca7982f659006027ba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit f4c15ef5413ca34b6b3d96f7d533bd3da32ab3f8)
(cherry picked from commit c52dca038117b0dd52cbe4482e67ea8bd48537a6)

feat(jobspec): Align weekly ndrpdr to daily mrr

+ This mainly uncomments a bucnh of 3n-alt xl710 ipsec tests.
+ Otherwise the difference was quite small.

Change-Id: I8b67fcce157f36ed79e9692a0581e1115b3f6886
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit c92d64074dfb49ddcb92da730b18f725c58eb002)
(cherry picked from commit c326f7594b530e80a30acc8486099078901ef40f)

feat(ipsec): Add suites for more algs

+ Add suite with UDP encap.
+ Add suite with anti replay enabled.
+ Add new enums where needed by the new suites.
+ Apply trimming in enum_util to support "3DES".
+ All 10ktnl suites written and tested.
 + New robot tags added.
+ Fix one comment from the parent.

Change-Id: I2581814dbb327891d8658dd009c4e52ffd318e3b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b9dff484de0725bca3f65739519d952e3be55cbe)

fix(hoststack): Do not limit number of RX queues

This makes most scale hoststack tests correctly use both sibling cores.

- Except quic multi-client ones, which start failing instead.
 - To be fixed later.
 - VPP startup.conf looks correct to me.
 - All quic tests suffer from CSIT-1935 so no big loss.

Change-Id: If22c01651140865e188733039890f1fb0ceaa57a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e417ac6f71f32064075d7f270c71f18f4cbe6f69)

feat(hoststack): Add stat pre/post actions

While adding runtime actions to hoststack tests is not easy,
adding pre and post actions for stats is easy.
The main hoststack measurement is treated as the stats trial,
the same way as the 10 measurements in MRR tests are.

+ Remove the previous partial info via "show" CLI commands.
- As in other VPP tests, stat telemetry is not exported.

Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 3dc8a53fc419e0491d1bd53e23473aed019fedc1)

feat(jobspecs): Add more soak tests

+ Add l2xcbase.
+ Add 200k scale, both ip4 and ip6.
+ Test 200k and l2bdmaclearn also on:
 + Primary NIC with secondary driver.
 + Secondary NIC and its primary driver.
+ Add 1518B memif test cases, for 2n-spr also with DMA (including 64B).
 + This needed an edit in autogen.
+ Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those.
+ Add two SRv6 cases to 3n-icx as it does not support hwasync crypto.
+ Repair name of UDP ASTF tests.

Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 3d20e3980839f01466c5750c2372fba55c47768e)

feat(profiles): Do not share seeds between streams

Avoiding any predictable memory access patterns
is more important than similarity between 2p and 6p profiles.

+ Seed values now match parts of IP source address.

Change-Id: Ib1830cf9d3e7b329e54de19a92ecea77c8baeeb5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 3151535b07b7602e73925224250670af9449db68)

feat(hoststack): Enable L4 checksum RX offload

As hoststack is never tested in container/VM (yet),
configuration there does not check the new flag.

Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit e66952b110969a1f0d2369847c39953197d57734)

style(jumbo): Unify naming of jumbo flag

Previously, the flag was sometimes called "jumbo",
sometimes "jumbo_frames". As we never use "jumbo" for things
other than frame size, unify the flag to "jumbo".

Change-Id: Ib688389799a4550ac9f51375f4defc06a02e6f03
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 10e9064182d5590d96afb335a24d583b5c8222f4)

Revert "feat(hoststack): Enable L4 checksum RX offload"

This reverts commit a8293c188485d69bd5e2dd161d4b0fd38df85bbf.

Reason for revert: Container/Qemu is not conditioned.

Change-Id: If822577dd83eb8c8b2db078ed99375bc2606b8bd
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

feat(hoststack): Enable L4 checksum RX offload

Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5)

fix(packer): Update AWS image

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I1907fcb88dff0bb62cc6f5a8bf3ea58e3ad1578d
(cherry picked from commit fa300743951b31a8109769c075d1edba9e6a85bd)

feat(terraform): New AWS AMI image

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I6951c4fc9f96a0acf44ba3201c91c9cb903889d7
(cherry picked from commit 5bb211044c10e791277d7de8561dc50af30c6abc)

fix(core): AWS interface initialization

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803
(cherry picked from commit 5ab88c226c98bc2e47ca93ef8538e7b10a073427)

style(crypto): Move robot tag DRV_VFIO_PCI

Move DRV_VFIO_PCI after TXQ_SIZE_0.
Upcoming suites need more space in the preceding line.

131 suite files edited, luckily doable by two commands:
$ sed -i 's/ | DRV_VFIO_PCI//' *.robot
$ sed -i 's/ | TXQ_SIZE_0/ | TXQ_SIZE_0 | DRV_VFIO_PCI/' *.robot

Change-Id: Idf30d20d321922718d523a216056d22ae67e50aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 26b060d6da1bf6abd46089be73c5ab70ec4aff05)
(cherry picked from commit 5db639e6a0f9112f97dcb52d7a6b1eb8cd540326)

Initial update of VPP_STABLE_VER files

Change-Id: I756b6662bc8ed137ce70882c3c0f14f7c8a02adb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fix(etl): Typo"

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ibd49015bc810a040d28509efc2e4bca26875229e

feat(etl): Release pipelines

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4ce20267b4747bf1901b6175e0ec5936b583a510

Update DPDK_STABLE_VER files

Change-Id: Ia4355295e783f29c87db6ed009370bd794d9b4ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>

C-Doc: Add placeholder for 2406 rls notes.

Change-Id: I89f2d314ff5ed33a86407489733544f197ad3d87
Signed-off-by: Tibor Frank <tifrank@cisco.com>

C-Dash: Enable reading of constants from env variables

+ add switching on/off the apps

Change-Id: I46e0cd2f214fd6a05ec0b87a433708bc4b6e2eb1
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fix(various): files

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I601a54e543114957592548618df2f2f4bf790f82

fix(hoststack): Use TX checksum offload

Some tests were already doing that via Set Test Variable,
this moves the flag into Variables table for every suite.

Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(perf): Increase threshold for jumbo

The old limit of 1522 was introduced long time ago.
First, it appeared here [0], where it is correct
as that suite has zero overhead.
The first suite with wrong logic seems to be here [1]
(no "Add No Multi Seg to all DUTs" in 1518B testcase).
And when I was moving that logic to a keyword in [2],
I did not realize it is wrong with overhead.

This Change uses 1800 as the new threshold,
matching the value used for non-jumbo MTU.

[0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70
[1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229
[2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84

Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update VPP_STABLE_VER files

Change-Id: I818cc10e971c85cd8e712c05536b5813bf18749a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

feat(device): Reconfigure

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654

feat(bootstrap): Add more granular eb scripts

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536

feat(CpuUtils): Allow suites to forbid siblings

Some perf suites use a single unidirectional flow of traffic.
On SMT-enabled machines, 1C tests create 2 workers by default.
But if there is only one stream/flow,
only one worker does useful work.
The other worker on the sibling logical core
does busy-wait, which provably lowers the peformance.

Some suites already set smt_used (as a suite variable)
to False for these purposes.
This change edits a lower-level L1 keyword to honor this value,
and adds the suite variable to single stream (and client) hoststack
suites, where the detrimental effect of busy siblings was observed.

Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(hoststack): Apply no-muti-seg

+ State frame size as 1518 octets, even if some packets are smaller.
 + This implicitly makes CSIT keywords to apply n-milti-seg.
- Real frame size is currently not important.

Change-Id: I754eac7e7ebf0378efb27149862004e35c387505
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update VPP_STABLE_VER files

Change-Id: I8ab964a6196dc3e81a4b7a9e7d8a7f0c0e2a0002
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Add 2048B file size  cps rps tests in job specs for http-ldpreload-nginx-1_21_5.

Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Change-Id: Id4b562259e6d86642152298bf500b353f1785939
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>

C-Dash: replace s3-logs by logs

Change-Id: Ib702521379e3f93b6e223882e187827e84b1189c
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Update VPP_STABLE_VER files

Change-Id: I09706e24780e34dc8f02e36acc25ec7066aea9cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Revert "fix(jobspec): Delete ipsec nfv density tests"

This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4.

Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

Revert "feat(profiles): Do not repeat seeds in 6p profiles"

This reverts commit b8f31fc3da4b0a6ab5805eea61af0fe7e869a453.

Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

Revert "style(scale): Apply black to new traffic profiles"

This reverts commit 4e2635deff33db4bea476003ac222ffd9ab504b1.

Change-Id: Idb9145fbf13e7943392a72f77ef9a1b479187732
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

feat(ipsec): Use strings instead of enums in Robot

Only related to enums appearing in ipsec suites.

+ Add conversion utility as enum_utils.py file.
+ Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction.
+ Device and perf suites updated to use str in Variables table.
 - Perf suites are being tested.

Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(hoststack): Remove unwanted api trace in DMA test

Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5
Signed-off-by: Kai Ji <kai.ji@intel.com>

style(scale): Apply black to new traffic profiles

+ Add trailing commas to prevent black from collapsing argument lists.

Change-Id: I8a2f2aca0df7a9271a073f87603f9abfa4870b11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(profiles): Do not repeat seeds in 6p profiles

On one hand, using seed==1 for all W-E streams
and seed=2 for all E-W streams would make 6p tests
even more comparable with 2p tests.
But current rnd profiles were mixing the two seed values.

On the other hand, using unique seed values for each stream
would ensure VPP is less likely to deviate from average preformance.
As the second approach also results in smaller profile files,
this patch applies that approach.

Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(profiles): Properly randomize in last profile

The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py
was not properly edited when converting from a non-random profile.

Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

cleanup(ip4scale): Delete recently orphaned rnd profiles

The rnd suites were already migrated to use the -2p profiles instead.

The non-rnd traffic profiles (without -2p) are still used
in trex suites and some ipsec suites, so they cannot be removed yet.

Change-Id: Ibc97b039c218418701081d3838ef40987110ef64
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update VPP_STABLE_VER files

Change-Id: I927f8aa6797fd6f081bc2f618b1b7e379aaa3e12
Signed-off-by: Tibor Frank <tifrank@cisco.com>

job-spec: fix dma

Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5

- 2n-icx and
- 2n-spr

Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Revert "fix(IPsecUtil): Delete keywords no longer used"

This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4.

Peter says he is using those.

Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(IPsecUtil): Delete keywords no longer used

When deleting ipsec nvf density suites,
I removed the main L2 Robot keyword,
but forgot to remove the associated L1 Python keywords.

Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(jobspec): Delete ipsec nfv density tests

We already deleted the job and the suites.

Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(tests): IPsecHW rxq ratio

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I17866709e1c7edf078055aef4db15774e136b111

feat(profiles): IPv6 unseed

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I72a91c6270bd43fd41b8d7389b759305d9a3d408

feat(density): Delete ipsec nfv_density tests

They are broken for more than two years
and they relied on CLIs that changed in VPP anyway.

Ticket: CSIT-1856

Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(methodology): Update info for soak and ndrpdr

Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I1e874ad107dd961e886e544f7d7017086523f894
Signed-off-by: Tibor Frank <tifrank@cisco.com>

C-Dash: Add soak tests

Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736
Signed-off-by: Tibor Frank <tifrank@cisco.com>

job-spec: Add ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>

feat(profiles): Cleanup IPv6 profiles

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8

Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

fix(ip6scale): Unify rnd profiles

Some were not even using STLVmFlowVarRepeatableRandom.

+ Simplify seed calculation.

Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

style(ipsec): add type hints to IPsecUtil

+ Update docstrings to match.

Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(etl): SOAK

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38

style(ipsec): Unify mutiline strings

+ One more pylint improvement not worth a separate change.

Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

style(ipsec): Fix some issues reported by pylint

+ Fix typo "enale".
- Many style and complexity issues remain:
  C0302, R0904, R0914, R0913, R1735, R0915, R1734.

Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Add hoststack with DMA test suites

Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>

fix(ip6scale): Document correct prefix length

We are testing /128 in ip6 scale tests for a long time,
but we did not update the suite documentation when we switched.
This does that.
Note that ip6 bas (and feature) tests are still using /64.

Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update VPP_STABLE_VER files

Change-Id: If4175b67b34c96a097cbc7f250535159eef816be
Signed-off-by: Tibor Frank <tifrank@cisco.com>

feat(jobspec): Unify soak jobspecs

Added 9 common tests (only one for non-default NIC+driver),
4 specific to nodeness (ASTF for 2-node, IPsec for 3-node).

+ First round, we can add more tests when duration is stable.
- Left TODOs for possible improvements.

Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(tests): IPv6 fixes

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f

feat(job_specs): Add soak test

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e

Revert "fix(ip6): Use updated profile names in 2n suites"

This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9.

Reason for revert: Makes no sense

Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>

fix(ipsec): Prepare IPsecUtil for upcoming changes

+ Separate sad into two cycles.
+ Do not update flags in each iteration.
+ Update inner dicts.

Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

style(ipsec): Do not import ipsec.robot to suites

It is already available via default.robot import.

Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(tox): add copyright year fixer script

It uses rather simple sed commands, but seems to work well enough.

+ Improve readme.
+ Shortened comments about why 3 lines.

Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(ip6): Use updated profile names in 2n suites

Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

style(IPsecUtil): Apply black formatting

Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

feat(api): Use newest API messages after rls2402

+ gtpu_add_del_tunnel_v2
 + Add comments on used values and unused fields.
+ ipsec_sad_entry_add_v2
 + Explicitly pass current default values.
+ ipsec_sa_v5_dump
+ policer_add
 + The old is_add argument removed, it was never false.
+ sr_policy_add_v2
 + Add comments about currently unused fields.
 + Support also older VP builds with wrong reply.
+ rdma_create_v4
 + Add comments about unused fields.

Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update VPP_STABLE_VER files

Change-Id: If792605aebeeedc722bc677b693be75858ac61e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>

feat(tests): IPv6 scale

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I720b7c96a6ac9f328aff57437e51254364604911

feat(job-spec): Unify memif 1518B tests for 2n-spr

+ Add 4c 1518B tests to all memif 2n-spr coverage suites.
+ Add 1518B cases to iterative, so recently added DMA can be compared.

Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(report): Update RCA

Probably last update this cycle.
Few remamining failures were seen,
but they are probably too rare to reproduce.

Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(perpatch): Sort comparison output by test name

Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

Update VPP_STABLE_VER files

Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Fix(perpatch): improve compare script output

+ Make tests more searchable by "Test name" prefix.
+ Shorten the output code (fewer duplication and continues).

Change-Id: I0adfac146a689466345a30646e41fe948ea264ae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

job-spec: Add memif DMA 1518B tests

Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Revert "fix(topologies): Disable tb31 so jobs use tb32"

This reverts commit 2734517899b6c109da520e6aef0866c8b78ec708.

Reason for revert: not a proper solution, just hides an issue

Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817
Signed-off-by: Peter Mikus <pmikus@cisco.com>

Update VPP_STABLE_VER files

Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

fix(topologies): Disable tb31 so jobs use tb32

As tb31 is the first reserved for 3n-icxd jobs,
most runs are currently failing due to CSIT-1951
(TwentyFiveGigabitEthernet89/0/2 does not do up).

Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(report): Update RCA for this week

Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(perpatch): Do not repeat test name

When searching for a specific test,
it is confusing to see the name twice,
first time close to previous test classification.

Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(terraform): vpp-device files

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12

Update VPP_STABLE_VER files

Change-Id: I32b3ae5beeeb42a6d4ccbe38d92b95c7803c2e01
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Revert "fix(core): Disable core dbg analysis"

This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d.

+ Add 10 second sleep, could help if core is big.

Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

C-Dash: Add detailed views to comparison tables

Change-Id: I0936f736497299f8b9fc1254012b2a0b20c41bfb
Signed-off-by: Tibor Frank <tifrank@cisco.com>

feat(tests): Remove unsupported suites

The new suites were added in [1]
and the VPP functionality was removed in [2].

[1] https://gerrit.fd.io/r/c/csit/+/28508
[2] https://gerrit.fd.io/r/c/vpp/+/31443

Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

fix(report): Two more issues found so far

Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

job-spec: Add DMA tests

Change-Id: I6530519eaab2d09a187dddd803815888606ff17d
Signed-off-by: Tibor Frank <tifrank@cisco.com>

Update VPP_STABLE_VER files

Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a
Signed-off-by: Tibor Frank <tifrank@cisco.com>

feat(tests): Fix scaling of 6p3nic

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271

feat(report): Add currently known issues

Analysis is not finished yet, some updates may arrive next week.

Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>

C-Dash: Add tooltips

Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5
Signed-off-by: Tibor Frank <tifrank@cisco.com>