csit.git
11 hours agoC-Dash: Enable reading of constants from env variables 00/40900/7 master
Tibor Frank [Mon, 20 May 2024 07:59:30 +0000 (07:59 +0000)]
C-Dash: Enable reading of constants from env variables

+ add switching on/off the apps

Change-Id: I46e0cd2f214fd6a05ec0b87a433708bc4b6e2eb1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
12 hours agofix(various): files 08/40908/2
pmikus [Tue, 21 May 2024 13:28:21 +0000 (15:28 +0200)]
fix(various): files

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I601a54e543114957592548618df2f2f4bf790f82

14 hours agofix(hoststack): Use TX checksum offload 06/40906/1
Vratko Polak [Tue, 21 May 2024 10:49:42 +0000 (12:49 +0200)]
fix(hoststack): Use TX checksum offload

Some tests were already doing that via Set Test Variable,
this moves the flag into Variables table for every suite.

Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
34 hours agofix(perf): Increase threshold for jumbo 01/40901/2
Vratko Polak [Mon, 20 May 2024 15:01:11 +0000 (17:01 +0200)]
fix(perf): Increase threshold for jumbo

The old limit of 1522 was introduced long time ago.
First, it appeared here [0], where it is correct
as that suite has zero overhead.
The first suite with wrong logic seems to be here [1]
(no "Add No Multi Seg to all DUTs" in 1518B testcase).
And when I was moving that logic to a keyword in [2],
I did not realize it is wrong with overhead.

This Change uses 1800 as the new threshold,
matching the value used for non-jumbo MTU.

[0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70
[1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229
[2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84

Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
43 hours agoUpdate VPP_STABLE_VER files 12/40812/2
Tibor Frank [Mon, 20 May 2024 06:17:36 +0000 (06:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I818cc10e971c85cd8e712c05536b5813bf18749a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 days agofeat(device): Reconfigure 95/40895/4
pmikus [Fri, 17 May 2024 06:13:36 +0000 (06:13 +0000)]
feat(device): Reconfigure

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654

5 days agofeat(bootstrap): Add more granular eb scripts 94/40894/2
pmikus [Thu, 16 May 2024 08:56:08 +0000 (10:56 +0200)]
feat(bootstrap): Add more granular eb scripts

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536

7 days agofeat(CpuUtils): Allow suites to forbid siblings 86/40886/4
Vratko Polak [Tue, 14 May 2024 13:07:58 +0000 (15:07 +0200)]
feat(CpuUtils): Allow suites to forbid siblings

Some perf suites use a single unidirectional flow of traffic.
On SMT-enabled machines, 1C tests create 2 workers by default.
But if there is only one stream/flow,
only one worker does useful work.
The other worker on the sibling logical core
does busy-wait, which provably lowers the peformance.

Some suites already set smt_used (as a suite variable)
to False for these purposes.
This change edits a lower-level L1 keyword to honor this value,
and adds the suite variable to single stream (and client) hoststack
suites, where the detrimental effect of busy siblings was observed.

Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agofeat(hoststack): Apply no-muti-seg 85/40885/2
Vratko Polak [Mon, 13 May 2024 17:25:58 +0000 (19:25 +0200)]
feat(hoststack): Apply no-muti-seg

+ State frame size as 1518 octets, even if some packets are smaller.
 + This implicitly makes CSIT keywords to apply n-milti-seg.
- Real frame size is currently not important.

Change-Id: I754eac7e7ebf0378efb27149862004e35c387505
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agoUpdate VPP_STABLE_VER files 11/40811/2
Tibor Frank [Mon, 13 May 2024 05:15:35 +0000 (05:15 +0000)]
Update VPP_STABLE_VER files

Change-Id: I8ab964a6196dc3e81a4b7a9e7d8a7f0c0e2a0002
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoAdd 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5. 47/40847/4 oper-240513
Maciek Konstantynowicz [Tue, 30 Apr 2024 16:35:33 +0000 (17:35 +0100)]
Add 2048B file size  cps rps tests in job specs for http-ldpreload-nginx-1_21_5.

Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Change-Id: Id4b562259e6d86642152298bf500b353f1785939
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2 weeks agoC-Dash: replace s3-logs by logs 71/40871/1
Tibor Frank [Mon, 6 May 2024 10:12:01 +0000 (10:12 +0000)]
C-Dash: replace s3-logs by logs

Change-Id: Ib702521379e3f93b6e223882e187827e84b1189c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoUpdate VPP_STABLE_VER files 09/40809/2
Tibor Frank [Mon, 6 May 2024 06:11:10 +0000 (06:11 +0000)]
Update VPP_STABLE_VER files

Change-Id: I09706e24780e34dc8f02e36acc25ec7066aea9cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agoRevert "fix(jobspec): Delete ipsec nfv density tests" 08/40808/2
Peter Mikus [Wed, 1 May 2024 05:04:03 +0000 (05:04 +0000)]
Revert "fix(jobspec): Delete ipsec nfv density tests"

This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4.

Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2 weeks agoRevert "feat(profiles): Do not repeat seeds in 6p profiles" 07/40807/2
Peter Mikus [Wed, 1 May 2024 04:55:46 +0000 (04:55 +0000)]
Revert "feat(profiles): Do not repeat seeds in 6p profiles"

This reverts commit b8f31fc3da4b0a6ab5805eea61af0fe7e869a453.

Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2 weeks agoRevert "style(scale): Apply black to new traffic profiles" 06/40806/2
Peter Mikus [Wed, 1 May 2024 04:54:27 +0000 (04:54 +0000)]
Revert "style(scale): Apply black to new traffic profiles"

This reverts commit 4e2635deff33db4bea476003ac222ffd9ab504b1.

Change-Id: Idb9145fbf13e7943392a72f77ef9a1b479187732
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
3 weeks agofeat(ipsec): Use strings instead of enums in Robot 49/40749/17
Vratko Polak [Fri, 26 Apr 2024 11:58:43 +0000 (13:58 +0200)]
feat(ipsec): Use strings instead of enums in Robot

Only related to enums appearing in ipsec suites.

+ Add conversion utility as enum_utils.py file.
+ Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction.
+ Device and perf suites updated to use str in Variables table.
 - Perf suites are being tested.

Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(hoststack): Remove unwanted api trace in DMA test 86/40786/3
Kai Ji [Wed, 24 Apr 2024 16:18:42 +0000 (16:18 +0000)]
fix(hoststack): Remove unwanted api trace in DMA test

Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5
Signed-off-by: Kai Ji <kai.ji@intel.com>
3 weeks agostyle(scale): Apply black to new traffic profiles 45/40845/1
Vratko Polak [Tue, 30 Apr 2024 12:55:15 +0000 (14:55 +0200)]
style(scale): Apply black to new traffic profiles

+ Add trailing commas to prevent black from collapsing argument lists.

Change-Id: I8a2f2aca0df7a9271a073f87603f9abfa4870b11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofeat(profiles): Do not repeat seeds in 6p profiles 44/40844/1
Vratko Polak [Tue, 30 Apr 2024 12:54:57 +0000 (14:54 +0200)]
feat(profiles): Do not repeat seeds in 6p profiles

On one hand, using seed==1 for all W-E streams
and seed=2 for all E-W streams would make 6p tests
even more comparable with 2p tests.
But current rnd profiles were mixing the two seed values.

On the other hand, using unique seed values for each stream
would ensure VPP is less likely to deviate from average preformance.
As the second approach also results in smaller profile files,
this patch applies that approach.

Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(profiles): Properly randomize in last profile 43/40843/1
Vratko Polak [Tue, 30 Apr 2024 12:54:36 +0000 (14:54 +0200)]
fix(profiles): Properly randomize in last profile

The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py
was not properly edited when converting from a non-random profile.

Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agocleanup(ip4scale): Delete recently orphaned rnd profiles 42/40842/2
Vratko Polak [Tue, 30 Apr 2024 12:54:15 +0000 (14:54 +0200)]
cleanup(ip4scale): Delete recently orphaned rnd profiles

The rnd suites were already migrated to use the -2p profiles instead.

The non-rnd traffic profiles (without -2p) are still used
in trex suites and some ipsec suites, so they cannot be removed yet.

Change-Id: Ibc97b039c218418701081d3838ef40987110ef64
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoUpdate VPP_STABLE_VER files 99/40799/3
Tibor Frank [Mon, 29 Apr 2024 04:30:39 +0000 (04:30 +0000)]
Update VPP_STABLE_VER files

Change-Id: I927f8aa6797fd6f081bc2f618b1b7e379aaa3e12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agojob-spec: fix dma 34/40834/1
Tibor Frank [Mon, 29 Apr 2024 05:12:22 +0000 (05:12 +0000)]
job-spec: fix dma

Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agojob-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5 33/40833/2
Tibor Frank [Mon, 29 Apr 2024 04:51:34 +0000 (04:51 +0000)]
job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5

- 2n-icx and
- 2n-spr

Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoRevert "fix(IPsecUtil): Delete keywords no longer used" 28/40828/2
Vratko Polak [Fri, 26 Apr 2024 13:39:12 +0000 (15:39 +0200)]
Revert "fix(IPsecUtil): Delete keywords no longer used"

This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4.

Peter says he is using those.

Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(IPsecUtil): Delete keywords no longer used 27/40827/2
Vratko Polak [Fri, 26 Apr 2024 12:44:46 +0000 (14:44 +0200)]
fix(IPsecUtil): Delete keywords no longer used

When deleting ipsec nvf density suites,
I removed the main L2 Robot keyword,
but forgot to remove the associated L1 Python keywords.

Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(jobspec): Delete ipsec nfv density tests 26/40826/1
Vratko Polak [Fri, 26 Apr 2024 12:33:33 +0000 (14:33 +0200)]
fix(jobspec): Delete ipsec nfv density tests

We already deleted the job and the suites.

Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofeat(tests): IPsecHW rxq ratio 24/40824/2
pmikus [Fri, 26 Apr 2024 11:26:38 +0000 (11:26 +0000)]
feat(tests): IPsecHW rxq ratio

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I17866709e1c7edf078055aef4db15774e136b111

3 weeks agofeat(profiles): IPv6 unseed 22/40822/1
pmikus [Fri, 26 Apr 2024 06:05:44 +0000 (06:05 +0000)]
feat(profiles): IPv6 unseed

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I72a91c6270bd43fd41b8d7389b759305d9a3d408

3 weeks agofeat(density): Delete ipsec nfv_density tests 19/40819/2
Vratko Polak [Thu, 25 Apr 2024 13:56:54 +0000 (15:56 +0200)]
feat(density): Delete ipsec nfv_density tests

They are broken for more than two years
and they relied on CLIs that changed in VPP anyway.

Ticket: CSIT-1856

Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(methodology): Update info for soak and ndrpdr 94/40794/2
Vratko Polak [Thu, 25 Apr 2024 11:39:05 +0000 (13:39 +0200)]
fix(methodology): Update info for soak and ndrpdr

Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agojob-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd 93/40793/1
Tibor Frank [Thu, 25 Apr 2024 11:20:10 +0000 (11:20 +0000)]
job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I1e874ad107dd961e886e544f7d7017086523f894
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoC-Dash: Add soak tests 76/40776/6
Tibor Frank [Tue, 23 Apr 2024 12:04:13 +0000 (12:04 +0000)]
C-Dash: Add soak tests

Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agojob-spec: Add ipsec hw tests to 3n-snr and 3n-icxd 90/40790/2
Tibor Frank [Thu, 25 Apr 2024 05:51:25 +0000 (05:51 +0000)]
job-spec: Add ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agofeat(profiles): Cleanup IPv6 profiles 91/40791/1
pmikus [Thu, 25 Apr 2024 05:49:13 +0000 (05:49 +0000)]
feat(profiles): Cleanup IPv6 profiles

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8

3 weeks agoRevert "fix(ip6scale): Unify rnd profiles" 95/40695/2
Peter Mikus [Thu, 25 Apr 2024 05:00:58 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
3 weeks agoRevert "fix(ip6scale): Unify rnd profiles" 94/40694/1
Peter Mikus [Thu, 25 Apr 2024 05:00:10 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
3 weeks agofix(ip6scale): Unify rnd profiles 85/40785/1
Vratko Polak [Wed, 24 Apr 2024 11:11:27 +0000 (13:11 +0200)]
fix(ip6scale): Unify rnd profiles

Some were not even using STLVmFlowVarRepeatableRandom.

+ Simplify seed calculation.

Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agostyle(ipsec): add type hints to IPsecUtil 73/40773/2
Vratko Polak [Mon, 22 Apr 2024 15:59:42 +0000 (17:59 +0200)]
style(ipsec): add type hints to IPsecUtil

+ Update docstrings to match.

Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofeat(etl): SOAK 77/40777/1
pmikus [Tue, 23 Apr 2024 12:31:32 +0000 (14:31 +0200)]
feat(etl): SOAK

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38

4 weeks agostyle(ipsec): Unify mutiline strings 70/40770/2
Vratko Polak [Mon, 22 Apr 2024 14:24:54 +0000 (16:24 +0200)]
style(ipsec): Unify mutiline strings

+ One more pylint improvement not worth a separate change.

Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agostyle(ipsec): Fix some issues reported by pylint 51/40751/2
Vratko Polak [Fri, 19 Apr 2024 08:50:21 +0000 (10:50 +0200)]
style(ipsec): Fix some issues reported by pylint

+ Fix typo "enale".
- Many style and complexity issues remain:
  C0302, R0904, R0914, R0913, R1735, R0915, R1734.

Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoAdd hoststack with DMA test suites 16/39716/7
xinfengx [Thu, 19 Oct 2023 01:02:48 +0000 (01:02 +0000)]
Add hoststack with DMA test suites

Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
4 weeks agofix(ip6scale): Document correct prefix length 57/40757/1
Vratko Polak [Mon, 22 Apr 2024 08:52:32 +0000 (10:52 +0200)]
fix(ip6scale): Document correct prefix length

We are testing /128 in ip6 scale tests for a long time,
but we did not update the suite documentation when we switched.
This does that.
Note that ip6 bas (and feature) tests are still using /64.

Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agoUpdate VPP_STABLE_VER files 90/40690/2
Tibor Frank [Mon, 22 Apr 2024 04:04:28 +0000 (04:04 +0000)]
Update VPP_STABLE_VER files

Change-Id: If4175b67b34c96a097cbc7f250535159eef816be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agofeat(jobspec): Unify soak jobspecs 48/40748/2
Vratko Polak [Thu, 18 Apr 2024 12:45:29 +0000 (14:45 +0200)]
feat(jobspec): Unify soak jobspecs

Added 9 common tests (only one for non-default NIC+driver),
4 specific to nodeness (ASTF for 2-node, IPsec for 3-node).

+ First round, we can add more tests when duration is stable.
- Left TODOs for possible improvements.

Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofeat(tests): IPv6 fixes 47/40747/2
pmikus [Thu, 18 Apr 2024 10:37:09 +0000 (10:37 +0000)]
feat(tests): IPv6 fixes

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f

4 weeks agofeat(job_specs): Add soak test 43/40743/6
pmikus [Wed, 17 Apr 2024 13:22:13 +0000 (13:22 +0000)]
feat(job_specs): Add soak test

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e

4 weeks agoRevert "fix(ip6): Use updated profile names in 2n suites" 83/40683/2
Peter Mikus [Thu, 18 Apr 2024 06:57:25 +0000 (06:57 +0000)]
Revert "fix(ip6): Use updated profile names in 2n suites"

This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9.

Reason for revert: Makes no sense

Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
4 weeks agofix(ipsec): Prepare IPsecUtil for upcoming changes 15/40715/4
Vratko Polak [Wed, 17 Apr 2024 08:52:33 +0000 (10:52 +0200)]
fix(ipsec): Prepare IPsecUtil for upcoming changes

+ Separate sad into two cycles.
+ Do not update flags in each iteration.
+ Update inner dicts.

Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agostyle(ipsec): Do not import ipsec.robot to suites 44/40744/2
Vratko Polak [Wed, 17 Apr 2024 15:26:56 +0000 (17:26 +0200)]
style(ipsec): Do not import ipsec.robot to suites

It is already available via default.robot import.

Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofeat(tox): add copyright year fixer script 54/35154/15
Vratko Polak [Wed, 17 Apr 2024 15:24:24 +0000 (17:24 +0200)]
feat(tox): add copyright year fixer script

It uses rather simple sed commands, but seems to work well enough.

+ Improve readme.
+ Shortened comments about why 3 lines.

Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofix(ip6): Use updated profile names in 2n suites 41/40741/2
Vratko Polak [Wed, 17 Apr 2024 12:49:59 +0000 (14:49 +0200)]
fix(ip6): Use updated profile names in 2n suites

Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agostyle(IPsecUtil): Apply black formatting 14/40714/1
Vratko Polak [Tue, 16 Apr 2024 11:58:58 +0000 (13:58 +0200)]
style(IPsecUtil): Apply black formatting

Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agofeat(api): Use newest API messages after rls2402 98/40698/7
Vratko Polak [Thu, 11 Apr 2024 16:24:03 +0000 (18:24 +0200)]
feat(api): Use newest API messages after rls2402

+ gtpu_add_del_tunnel_v2
 + Add comments on used values and unused fields.
+ ipsec_sad_entry_add_v2
 + Explicitly pass current default values.
+ ipsec_sa_v5_dump
+ policer_add
 + The old is_add argument removed, it was never false.
+ sr_policy_add_v2
 + Add comments about currently unused fields.
 + Support also older VP builds with wrong reply.
+ rdma_create_v4
 + Add comments about unused fields.

Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agoUpdate VPP_STABLE_VER files 81/40681/2
Tibor Frank [Mon, 15 Apr 2024 04:48:50 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: If792605aebeeedc722bc677b693be75858ac61e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agofeat(tests): IPv6 scale 24/40124/22
pmikus [Wed, 20 Dec 2023 13:28:36 +0000 (13:28 +0000)]
feat(tests): IPv6 scale

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I720b7c96a6ac9f328aff57437e51254364604911

5 weeks agofeat(job-spec): Unify memif 1518B tests for 2n-spr 73/40673/1
Vratko Polak [Wed, 10 Apr 2024 13:22:53 +0000 (15:22 +0200)]
feat(job-spec): Unify memif 1518B tests for 2n-spr

+ Add 4c 1518B tests to all memif 2n-spr coverage suites.
+ Add 1518B cases to iterative, so recently added DMA can be compared.

Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agofix(report): Update RCA 70/40670/1
Vratko Polak [Wed, 10 Apr 2024 10:34:02 +0000 (12:34 +0200)]
fix(report): Update RCA

Probably last update this cycle.
Few remamining failures were seen,
but they are probably too rare to reproduce.

Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agofix(perpatch): Sort comparison output by test name 59/40659/3
Vratko Polak [Tue, 9 Apr 2024 08:22:49 +0000 (10:22 +0200)]
fix(perpatch): Sort comparison output by test name

Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agoUpdate VPP_STABLE_VER files 76/40676/2
Tibor Frank [Mon, 8 Apr 2024 04:06:10 +0000 (04:06 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoFix(perpatch): improve compare script output 54/40654/1
Vratko Polak [Thu, 4 Apr 2024 11:01:47 +0000 (13:01 +0200)]
Fix(perpatch): improve compare script output

+ Make tests more searchable by "Test name" prefix.
+ Shorten the output code (fewer duplication and continues).

Change-Id: I0adfac146a689466345a30646e41fe948ea264ae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agojob-spec: Add memif DMA 1518B tests 48/40648/1
Tibor Frank [Wed, 3 Apr 2024 14:24:17 +0000 (14:24 +0000)]
job-spec: Add memif DMA 1518B tests

Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoRevert "fix(topologies): Disable tb31 so jobs use tb32" 91/40591/2
Peter Mikus [Tue, 2 Apr 2024 06:56:08 +0000 (06:56 +0000)]
Revert "fix(topologies): Disable tb31 so jobs use tb32"

This reverts commit 2734517899b6c109da520e6aef0866c8b78ec708.

Reason for revert: not a proper solution, just hides an issue

Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817
Signed-off-by: Peter Mikus <pmikus@cisco.com>
7 weeks agoUpdate VPP_STABLE_VER files 82/40582/2
Tibor Frank [Tue, 2 Apr 2024 04:17:46 +0000 (04:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agofix(topologies): Disable tb31 so jobs use tb32 17/40617/1
Vratko Polak [Wed, 27 Mar 2024 14:15:20 +0000 (15:15 +0100)]
fix(topologies): Disable tb31 so jobs use tb32

As tb31 is the first reserved for 3n-icxd jobs,
most runs are currently failing due to CSIT-1951
(TwentyFiveGigabitEthernet89/0/2 does not do up).

Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 weeks agofix(report): Update RCA for this week 16/40616/1
Vratko Polak [Wed, 27 Mar 2024 12:39:51 +0000 (13:39 +0100)]
fix(report): Update RCA for this week

Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 weeks agofix(perpatch): Do not repeat test name 07/40507/3
Vratko Polak [Wed, 13 Mar 2024 13:00:46 +0000 (14:00 +0100)]
fix(perpatch): Do not repeat test name

When searching for a specific test,
it is confusing to see the name twice,
first time close to previous test classification.

Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 weeks agofix(terraform): vpp-device files 03/40603/2
pmikus [Mon, 25 Mar 2024 13:49:25 +0000 (14:49 +0100)]
fix(terraform): vpp-device files

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12

8 weeks agoUpdate VPP_STABLE_VER files 80/40580/3
Tibor Frank [Mon, 25 Mar 2024 12:49:48 +0000 (12:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: I32b3ae5beeeb42a6d4ccbe38d92b95c7803c2e01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agoRevert "fix(core): Disable core dbg analysis" 51/39551/18
Vratko Polak [Mon, 18 Mar 2024 14:43:12 +0000 (15:43 +0100)]
Revert "fix(core): Disable core dbg analysis"

This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d.

+ Add 10 second sleep, could help if core is big.

Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 weeks agoC-Dash: Add detailed views to comparison tables 56/40556/6
Tibor Frank [Wed, 20 Mar 2024 05:43:03 +0000 (05:43 +0000)]
C-Dash: Add detailed views to comparison tables

Change-Id: I0936f736497299f8b9fc1254012b2a0b20c41bfb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofeat(tests): Remove unsupported suites 67/40567/2
Vratko Polak [Thu, 21 Mar 2024 09:03:01 +0000 (10:03 +0100)]
feat(tests): Remove unsupported suites

The new suites were added in [1]
and the VPP functionality was removed in [2].

[1] https://gerrit.fd.io/r/c/csit/+/28508
[2] https://gerrit.fd.io/r/c/vpp/+/31443

Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agofix(report): Two more issues found so far 49/40549/2
Vratko Polak [Tue, 19 Mar 2024 15:56:42 +0000 (16:56 +0100)]
fix(report): Two more issues found so far

Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agojob-spec: Add DMA tests 57/40557/1
Tibor Frank [Wed, 20 Mar 2024 06:25:35 +0000 (06:25 +0000)]
job-spec: Add DMA tests

Change-Id: I6530519eaab2d09a187dddd803815888606ff17d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 32/40432/2
Tibor Frank [Mon, 18 Mar 2024 05:33:05 +0000 (05:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofeat(tests): Fix scaling of 6p3nic 13/40513/4 oper-240318
pmikus [Wed, 13 Mar 2024 14:24:47 +0000 (14:24 +0000)]
feat(tests): Fix scaling of 6p3nic

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271

2 months agofeat(report): Add currently known issues 11/40511/1
Vratko Polak [Wed, 13 Mar 2024 12:18:17 +0000 (13:18 +0100)]
feat(report): Add currently known issues

Analysis is not finished yet, some updates may arrive next week.

Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoC-Dash: Add tooltips 01/40501/1
Tibor Frank [Tue, 12 Mar 2024 09:03:05 +0000 (09:03 +0000)]
C-Dash: Add tooltips

Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Dash: add "download row data" feature to comparison tables 99/40499/2
Tibor Frank [Mon, 11 Mar 2024 12:00:34 +0000 (12:00 +0000)]
C-Dash: add "download row data" feature to comparison tables

Change-Id: Iaf5a57402e954453c237fb1e082da6c620cff59f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Docs: Add a procedure to "Search tests". 96/40496/1
Tibor Frank [Mon, 11 Mar 2024 07:44:40 +0000 (07:44 +0000)]
C-Docs: Add a procedure to "Search tests".

Change-Id: I2b00894c6690cc1ae69d202f90fd9624c271832b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 30/40430/2
Tibor Frank [Mon, 11 Mar 2024 05:58:58 +0000 (05:58 +0000)]
Update VPP_STABLE_VER files

Change-Id: I70dcb89767587e225bf2585349211953e6ac8713
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Dash: Add possiblity to remove outliers from comparison data 66/40466/1
Tibor Frank [Thu, 7 Mar 2024 12:00:04 +0000 (12:00 +0000)]
C-Dash: Add possiblity to remove outliers from comparison data

- extreme outliers only for now

Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Docs: Update release information 53/40453/3
Tibor Frank [Mon, 4 Mar 2024 12:01:21 +0000 (12:01 +0000)]
C-Docs: Update release information

Change-Id: I77dbc422f502d0c342177598d30b3bcca7ea5e06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofeat(ietf): MLRsearch draft-06 73/39773/11
Vratko Polak [Tue, 5 Mar 2024 12:25:39 +0000 (13:25 +0100)]
feat(ietf): MLRsearch draft-06

Change-Id: Ia9e22ba1eca74a32ae7141b1bd111bdb9baaddf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agofeat(device): cx6 update of 1n-alt device jobspec 30/40330/9
Juraj Linkeš [Mon, 12 Feb 2024 10:25:41 +0000 (11:25 +0100)]
feat(device): cx6 update of 1n-alt device jobspec

Update the jobspec according to the current Arm policy:
1. Run most of the tests on cx6, crypto coverage being the most
   important,
2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver,
3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf)
   drivers.

The above is the policy used in performance testing where time is a
major constraint. The same is true for functional testing to some
extent, so it makes sense to apply the same logic for choosing the tests.

There are 10 tests which are failing on cx6 without an identified
reason. They are disabled until we find the root cause and address it.
In the meantime, the tests are enabled for x710 with the DPDK driver:
ethip4-l2xcbase-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2tap
ethip4-l2bdbasemaclrn
ethip4-l2bdbasemaclrn-iacl1sf
ethip4-l2bdbasemaclrn-iacl1sl
ethip4-l2bdbasemaclrn-oacl1sf
ethip4-l2bdbasemaclrn-oacl1sl
ethip4-l2patch
ethip4-l2xcbase

When the cx6 issue has been resolved, these should be enabled for cx6
and disabled for x710, with the exception of ethip4-l2bdbasemaclrn,
which should be running on both.

Change-Id: Id48f450063e405b1faca57431676f91d62e829b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 months agoUpdate VPP_STABLE_VER files 23/40423/2
Tibor Frank [Mon, 4 Mar 2024 06:59:44 +0000 (06:59 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib84e4f147583c25c3fccff27a493dc07b37f7d9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Dash: Add search in tests 67/40367/16 oper-240304
Tibor Frank [Tue, 20 Feb 2024 11:04:48 +0000 (11:04 +0000)]
C-Dash: Add search in tests

Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agojob-spec: add more ip4scale tests to 2n-spr and 3na-spr 06/40406/2
Tibor Frank [Wed, 28 Feb 2024 05:58:03 +0000 (05:58 +0000)]
job-spec: add more ip4scale tests to 2n-spr and 3na-spr

Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 16/40416/2
Tibor Frank [Mon, 26 Feb 2024 05:55:38 +0000 (05:55 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9d6047a698c485e664f67bb4ea8847f683d0f688
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoUpdate VPP_STABLE_VER files 14/40314/2 oper-240226
Tibor Frank [Mon, 19 Feb 2024 06:07:48 +0000 (06:07 +0000)]
Update VPP_STABLE_VER files

Change-Id: I84c7886a6181d24460665cd82ced2f83ced6f415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofeat(device): 1n-alt ansible improvement 56/40356/1 oper-240219
Juraj Linkeš [Fri, 16 Feb 2024 11:02:45 +0000 (12:02 +0100)]
feat(device): 1n-alt ansible improvement

We're seeing extra IGMP traffic which interferes with tests which must
be disabled. This is done by disabling the setting by default on all
interfaces.

The default setting is also adopted for other traffic-related
configuration:
Default sets the configuration when the interface is created. For
hardware interfaces, that is at boot time. For VF interfaces, when we
create them with the csit-initialize-vfs.sh script and for virtual
interfaces when they're created.
On the other hand, the all configuration option doesn't set the
configuration. It uses the current configuration value along with the
passed configuration value to produce a new value, which could be
expressed as:

f(old_value, value_from_all) -> new_value

Where f is a function specific to each configuration option. Using all
thus requires us to know the function and the old value which is less
reliable than just using default everywhere.

Also fix the 1n-alt VF init script.

Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 months agofeat(device): add cx6 to 1n-alt ansible 29/40329/2
Juraj Linkeš [Thu, 8 Feb 2024 12:10:30 +0000 (13:10 +0100)]
feat(device): add cx6 to 1n-alt ansible

Also update 1n-alt hardware with info from dmidecode and port names to
match the rules in Testbed Naming Convention.

Change-Id: Ib654adaec5667f0e79a3cb86edfbf4578f5c3d5f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
3 months agofix(core): daily jobs should not do prefixing 39/40339/1
pmikus [Thu, 15 Feb 2024 10:22:27 +0000 (10:22 +0000)]
fix(core): daily jobs should not do prefixing

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83

3 months agofix(bootstrap): typo 38/40338/2
pmikus [Thu, 15 Feb 2024 09:22:38 +0000 (10:22 +0100)]
fix(bootstrap): typo

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297

3 months agofix(core): Lower amount of TREX cores for external 34/40334/2
pmikus [Wed, 14 Feb 2024 10:09:27 +0000 (10:09 +0000)]
fix(core): Lower amount of TREX cores for external

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027

3 months agofeat(bootstrap): Add ability to load external NODE_FLAVOR 31/40331/1
pmikus [Tue, 13 Feb 2024 12:01:54 +0000 (13:01 +0100)]
feat(bootstrap): Add ability to load external NODE_FLAVOR

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75

3 months agofeat(core): QAT RXQ allocation 18/40318/5
pmikus [Wed, 7 Feb 2024 14:38:51 +0000 (15:38 +0100)]
feat(core): QAT RXQ allocation

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36

3 months agoUpdate VPP_STABLE_VER files 02/40302/2
Tibor Frank [Mon, 12 Feb 2024 06:19:06 +0000 (06:19 +0000)]
Update VPP_STABLE_VER files

Change-Id: I27030c7fed6afc0b7ea975f4a6a87d29571d48cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>