csit.git
30 hours agoRevert "fix(jobspec): Delete ipsec nfv density tests" 08/40808/2 master
Peter Mikus [Wed, 1 May 2024 05:04:03 +0000 (05:04 +0000)]
Revert "fix(jobspec): Delete ipsec nfv density tests"

This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4.

Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
30 hours agoRevert "feat(profiles): Do not repeat seeds in 6p profiles" 07/40807/2
Peter Mikus [Wed, 1 May 2024 04:55:46 +0000 (04:55 +0000)]
Revert "feat(profiles): Do not repeat seeds in 6p profiles"

This reverts commit b8f31fc3da4b0a6ab5805eea61af0fe7e869a453.

Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
30 hours agoRevert "style(scale): Apply black to new traffic profiles" 06/40806/2
Peter Mikus [Wed, 1 May 2024 04:54:27 +0000 (04:54 +0000)]
Revert "style(scale): Apply black to new traffic profiles"

This reverts commit 4e2635deff33db4bea476003ac222ffd9ab504b1.

Change-Id: Idb9145fbf13e7943392a72f77ef9a1b479187732
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
44 hours agofeat(ipsec): Use strings instead of enums in Robot 49/40749/17
Vratko Polak [Fri, 26 Apr 2024 11:58:43 +0000 (13:58 +0200)]
feat(ipsec): Use strings instead of enums in Robot

Only related to enums appearing in ipsec suites.

+ Add conversion utility as enum_utils.py file.
+ Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction.
+ Device and perf suites updated to use str in Variables table.
 - Perf suites are being tested.

Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
45 hours agofix(hoststack): Remove unwanted api trace in DMA test 86/40786/3
Kai Ji [Wed, 24 Apr 2024 16:18:42 +0000 (16:18 +0000)]
fix(hoststack): Remove unwanted api trace in DMA test

Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5
Signed-off-by: Kai Ji <kai.ji@intel.com>
46 hours agostyle(scale): Apply black to new traffic profiles 45/40845/1
Vratko Polak [Tue, 30 Apr 2024 12:55:15 +0000 (14:55 +0200)]
style(scale): Apply black to new traffic profiles

+ Add trailing commas to prevent black from collapsing argument lists.

Change-Id: I8a2f2aca0df7a9271a073f87603f9abfa4870b11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
46 hours agofeat(profiles): Do not repeat seeds in 6p profiles 44/40844/1
Vratko Polak [Tue, 30 Apr 2024 12:54:57 +0000 (14:54 +0200)]
feat(profiles): Do not repeat seeds in 6p profiles

On one hand, using seed==1 for all W-E streams
and seed=2 for all E-W streams would make 6p tests
even more comparable with 2p tests.
But current rnd profiles were mixing the two seed values.

On the other hand, using unique seed values for each stream
would ensure VPP is less likely to deviate from average preformance.
As the second approach also results in smaller profile files,
this patch applies that approach.

Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
46 hours agofix(profiles): Properly randomize in last profile 43/40843/1
Vratko Polak [Tue, 30 Apr 2024 12:54:36 +0000 (14:54 +0200)]
fix(profiles): Properly randomize in last profile

The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py
was not properly edited when converting from a non-random profile.

Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
46 hours agocleanup(ip4scale): Delete recently orphaned rnd profiles 42/40842/2
Vratko Polak [Tue, 30 Apr 2024 12:54:15 +0000 (14:54 +0200)]
cleanup(ip4scale): Delete recently orphaned rnd profiles

The rnd suites were already migrated to use the -2p profiles instead.

The non-rnd traffic profiles (without -2p) are still used
in trex suites and some ipsec suites, so they cannot be removed yet.

Change-Id: Ibc97b039c218418701081d3838ef40987110ef64
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 days agoUpdate VPP_STABLE_VER files 99/40799/3
Tibor Frank [Mon, 29 Apr 2024 04:30:39 +0000 (04:30 +0000)]
Update VPP_STABLE_VER files

Change-Id: I927f8aa6797fd6f081bc2f618b1b7e379aaa3e12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agojob-spec: fix dma 34/40834/1
Tibor Frank [Mon, 29 Apr 2024 05:12:22 +0000 (05:12 +0000)]
job-spec: fix dma

Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 days agojob-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5 33/40833/2
Tibor Frank [Mon, 29 Apr 2024 04:51:34 +0000 (04:51 +0000)]
job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5

- 2n-icx and
- 2n-spr

Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 days agoRevert "fix(IPsecUtil): Delete keywords no longer used" 28/40828/2
Vratko Polak [Fri, 26 Apr 2024 13:39:12 +0000 (15:39 +0200)]
Revert "fix(IPsecUtil): Delete keywords no longer used"

This reverts commit 79635f7cdfb7046230473570068f97a159cf87b4.

Peter says he is using those.

Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 days agofix(IPsecUtil): Delete keywords no longer used 27/40827/2
Vratko Polak [Fri, 26 Apr 2024 12:44:46 +0000 (14:44 +0200)]
fix(IPsecUtil): Delete keywords no longer used

When deleting ipsec nvf density suites,
I removed the main L2 Robot keyword,
but forgot to remove the associated L1 Python keywords.

Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 days agofix(jobspec): Delete ipsec nfv density tests 26/40826/1
Vratko Polak [Fri, 26 Apr 2024 12:33:33 +0000 (14:33 +0200)]
fix(jobspec): Delete ipsec nfv density tests

We already deleted the job and the suites.

Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 days agofeat(tests): IPsecHW rxq ratio 24/40824/2
pmikus [Fri, 26 Apr 2024 11:26:38 +0000 (11:26 +0000)]
feat(tests): IPsecHW rxq ratio

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I17866709e1c7edf078055aef4db15774e136b111

6 days agofeat(profiles): IPv6 unseed 22/40822/1
pmikus [Fri, 26 Apr 2024 06:05:44 +0000 (06:05 +0000)]
feat(profiles): IPv6 unseed

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I72a91c6270bd43fd41b8d7389b759305d9a3d408

6 days agofeat(density): Delete ipsec nfv_density tests 19/40819/2
Vratko Polak [Thu, 25 Apr 2024 13:56:54 +0000 (15:56 +0200)]
feat(density): Delete ipsec nfv_density tests

They are broken for more than two years
and they relied on CLIs that changed in VPP anyway.

Ticket: CSIT-1856

Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 days agofix(methodology): Update info for soak and ndrpdr 94/40794/2
Vratko Polak [Thu, 25 Apr 2024 11:39:05 +0000 (13:39 +0200)]
fix(methodology): Update info for soak and ndrpdr

Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 days agojob-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd 93/40793/1
Tibor Frank [Thu, 25 Apr 2024 11:20:10 +0000 (11:20 +0000)]
job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I1e874ad107dd961e886e544f7d7017086523f894
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agoC-Dash: Add soak tests 76/40776/6
Tibor Frank [Tue, 23 Apr 2024 12:04:13 +0000 (12:04 +0000)]
C-Dash: Add soak tests

Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agojob-spec: Add ipsec hw tests to 3n-snr and 3n-icxd 90/40790/2
Tibor Frank [Thu, 25 Apr 2024 05:51:25 +0000 (05:51 +0000)]
job-spec: Add ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 days agofeat(profiles): Cleanup IPv6 profiles 91/40791/1
pmikus [Thu, 25 Apr 2024 05:49:13 +0000 (05:49 +0000)]
feat(profiles): Cleanup IPv6 profiles

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8

7 days agoRevert "fix(ip6scale): Unify rnd profiles" 95/40695/2
Peter Mikus [Thu, 25 Apr 2024 05:00:58 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
7 days agoRevert "fix(ip6scale): Unify rnd profiles" 94/40694/1
Peter Mikus [Thu, 25 Apr 2024 05:00:10 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
8 days agofix(ip6scale): Unify rnd profiles 85/40785/1
Vratko Polak [Wed, 24 Apr 2024 11:11:27 +0000 (13:11 +0200)]
fix(ip6scale): Unify rnd profiles

Some were not even using STLVmFlowVarRepeatableRandom.

+ Simplify seed calculation.

Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agostyle(ipsec): add type hints to IPsecUtil 73/40773/2
Vratko Polak [Mon, 22 Apr 2024 15:59:42 +0000 (17:59 +0200)]
style(ipsec): add type hints to IPsecUtil

+ Update docstrings to match.

Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agofeat(etl): SOAK 77/40777/1
pmikus [Tue, 23 Apr 2024 12:31:32 +0000 (14:31 +0200)]
feat(etl): SOAK

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38

9 days agostyle(ipsec): Unify mutiline strings 70/40770/2
Vratko Polak [Mon, 22 Apr 2024 14:24:54 +0000 (16:24 +0200)]
style(ipsec): Unify mutiline strings

+ One more pylint improvement not worth a separate change.

Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 days agostyle(ipsec): Fix some issues reported by pylint 51/40751/2
Vratko Polak [Fri, 19 Apr 2024 08:50:21 +0000 (10:50 +0200)]
style(ipsec): Fix some issues reported by pylint

+ Fix typo "enale".
- Many style and complexity issues remain:
  C0302, R0904, R0914, R0913, R1735, R0915, R1734.

Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 days agoAdd hoststack with DMA test suites 16/39716/7
xinfengx [Thu, 19 Oct 2023 01:02:48 +0000 (01:02 +0000)]
Add hoststack with DMA test suites

Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
10 days agofix(ip6scale): Document correct prefix length 57/40757/1
Vratko Polak [Mon, 22 Apr 2024 08:52:32 +0000 (10:52 +0200)]
fix(ip6scale): Document correct prefix length

We are testing /128 in ip6 scale tests for a long time,
but we did not update the suite documentation when we switched.
This does that.
Note that ip6 bas (and feature) tests are still using /64.

Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 days agoUpdate VPP_STABLE_VER files 90/40690/2
Tibor Frank [Mon, 22 Apr 2024 04:04:28 +0000 (04:04 +0000)]
Update VPP_STABLE_VER files

Change-Id: If4175b67b34c96a097cbc7f250535159eef816be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
13 days agofeat(jobspec): Unify soak jobspecs 48/40748/2
Vratko Polak [Thu, 18 Apr 2024 12:45:29 +0000 (14:45 +0200)]
feat(jobspec): Unify soak jobspecs

Added 9 common tests (only one for non-default NIC+driver),
4 specific to nodeness (ASTF for 2-node, IPsec for 3-node).

+ First round, we can add more tests when duration is stable.
- Left TODOs for possible improvements.

Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
13 days agofeat(tests): IPv6 fixes 47/40747/2
pmikus [Thu, 18 Apr 2024 10:37:09 +0000 (10:37 +0000)]
feat(tests): IPv6 fixes

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f

2 weeks agofeat(job_specs): Add soak test 43/40743/6
pmikus [Wed, 17 Apr 2024 13:22:13 +0000 (13:22 +0000)]
feat(job_specs): Add soak test

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e

2 weeks agoRevert "fix(ip6): Use updated profile names in 2n suites" 83/40683/2
Peter Mikus [Thu, 18 Apr 2024 06:57:25 +0000 (06:57 +0000)]
Revert "fix(ip6): Use updated profile names in 2n suites"

This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9.

Reason for revert: Makes no sense

Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
2 weeks agofix(ipsec): Prepare IPsecUtil for upcoming changes 15/40715/4
Vratko Polak [Wed, 17 Apr 2024 08:52:33 +0000 (10:52 +0200)]
fix(ipsec): Prepare IPsecUtil for upcoming changes

+ Separate sad into two cycles.
+ Do not update flags in each iteration.
+ Update inner dicts.

Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agostyle(ipsec): Do not import ipsec.robot to suites 44/40744/2
Vratko Polak [Wed, 17 Apr 2024 15:26:56 +0000 (17:26 +0200)]
style(ipsec): Do not import ipsec.robot to suites

It is already available via default.robot import.

Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agofeat(tox): add copyright year fixer script 54/35154/15
Vratko Polak [Wed, 17 Apr 2024 15:24:24 +0000 (17:24 +0200)]
feat(tox): add copyright year fixer script

It uses rather simple sed commands, but seems to work well enough.

+ Improve readme.
+ Shortened comments about why 3 lines.

Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agofix(ip6): Use updated profile names in 2n suites 41/40741/2
Vratko Polak [Wed, 17 Apr 2024 12:49:59 +0000 (14:49 +0200)]
fix(ip6): Use updated profile names in 2n suites

Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agostyle(IPsecUtil): Apply black formatting 14/40714/1
Vratko Polak [Tue, 16 Apr 2024 11:58:58 +0000 (13:58 +0200)]
style(IPsecUtil): Apply black formatting

Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agofeat(api): Use newest API messages after rls2402 98/40698/7
Vratko Polak [Thu, 11 Apr 2024 16:24:03 +0000 (18:24 +0200)]
feat(api): Use newest API messages after rls2402

+ gtpu_add_del_tunnel_v2
 + Add comments on used values and unused fields.
+ ipsec_sad_entry_add_v2
 + Explicitly pass current default values.
+ ipsec_sa_v5_dump
+ policer_add
 + The old is_add argument removed, it was never false.
+ sr_policy_add_v2
 + Add comments about currently unused fields.
 + Support also older VP builds with wrong reply.
+ rdma_create_v4
 + Add comments about unused fields.

Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoUpdate VPP_STABLE_VER files 81/40681/2
Tibor Frank [Mon, 15 Apr 2024 04:48:50 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: If792605aebeeedc722bc677b693be75858ac61e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agofeat(tests): IPv6 scale 24/40124/22
pmikus [Wed, 20 Dec 2023 13:28:36 +0000 (13:28 +0000)]
feat(tests): IPv6 scale

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I720b7c96a6ac9f328aff57437e51254364604911

3 weeks agofeat(job-spec): Unify memif 1518B tests for 2n-spr 73/40673/1
Vratko Polak [Wed, 10 Apr 2024 13:22:53 +0000 (15:22 +0200)]
feat(job-spec): Unify memif 1518B tests for 2n-spr

+ Add 4c 1518B tests to all memif 2n-spr coverage suites.
+ Add 1518B cases to iterative, so recently added DMA can be compared.

Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(report): Update RCA 70/40670/1
Vratko Polak [Wed, 10 Apr 2024 10:34:02 +0000 (12:34 +0200)]
fix(report): Update RCA

Probably last update this cycle.
Few remamining failures were seen,
but they are probably too rare to reproduce.

Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agofix(perpatch): Sort comparison output by test name 59/40659/3
Vratko Polak [Tue, 9 Apr 2024 08:22:49 +0000 (10:22 +0200)]
fix(perpatch): Sort comparison output by test name

Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agoUpdate VPP_STABLE_VER files 76/40676/2
Tibor Frank [Mon, 8 Apr 2024 04:06:10 +0000 (04:06 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoFix(perpatch): improve compare script output 54/40654/1
Vratko Polak [Thu, 4 Apr 2024 11:01:47 +0000 (13:01 +0200)]
Fix(perpatch): improve compare script output

+ Make tests more searchable by "Test name" prefix.
+ Shorten the output code (fewer duplication and continues).

Change-Id: I0adfac146a689466345a30646e41fe948ea264ae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agojob-spec: Add memif DMA 1518B tests 48/40648/1
Tibor Frank [Wed, 3 Apr 2024 14:24:17 +0000 (14:24 +0000)]
job-spec: Add memif DMA 1518B tests

Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoRevert "fix(topologies): Disable tb31 so jobs use tb32" 91/40591/2
Peter Mikus [Tue, 2 Apr 2024 06:56:08 +0000 (06:56 +0000)]
Revert "fix(topologies): Disable tb31 so jobs use tb32"

This reverts commit 2734517899b6c109da520e6aef0866c8b78ec708.

Reason for revert: not a proper solution, just hides an issue

Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817
Signed-off-by: Peter Mikus <pmikus@cisco.com>
4 weeks agoUpdate VPP_STABLE_VER files 82/40582/2
Tibor Frank [Tue, 2 Apr 2024 04:17:46 +0000 (04:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agofix(topologies): Disable tb31 so jobs use tb32 17/40617/1
Vratko Polak [Wed, 27 Mar 2024 14:15:20 +0000 (15:15 +0100)]
fix(topologies): Disable tb31 so jobs use tb32

As tb31 is the first reserved for 3n-icxd jobs,
most runs are currently failing due to CSIT-1951
(TwentyFiveGigabitEthernet89/0/2 does not do up).

Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agofix(report): Update RCA for this week 16/40616/1
Vratko Polak [Wed, 27 Mar 2024 12:39:51 +0000 (13:39 +0100)]
fix(report): Update RCA for this week

Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agofix(perpatch): Do not repeat test name 07/40507/3
Vratko Polak [Wed, 13 Mar 2024 13:00:46 +0000 (14:00 +0100)]
fix(perpatch): Do not repeat test name

When searching for a specific test,
it is confusing to see the name twice,
first time close to previous test classification.

Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agofix(terraform): vpp-device files 03/40603/2
pmikus [Mon, 25 Mar 2024 13:49:25 +0000 (14:49 +0100)]
fix(terraform): vpp-device files

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12

5 weeks agoUpdate VPP_STABLE_VER files 80/40580/3
Tibor Frank [Mon, 25 Mar 2024 12:49:48 +0000 (12:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: I32b3ae5beeeb42a6d4ccbe38d92b95c7803c2e01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoRevert "fix(core): Disable core dbg analysis" 51/39551/18
Vratko Polak [Mon, 18 Mar 2024 14:43:12 +0000 (15:43 +0100)]
Revert "fix(core): Disable core dbg analysis"

This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d.

+ Add 10 second sleep, could help if core is big.

Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agoC-Dash: Add detailed views to comparison tables 56/40556/6
Tibor Frank [Wed, 20 Mar 2024 05:43:03 +0000 (05:43 +0000)]
C-Dash: Add detailed views to comparison tables

Change-Id: I0936f736497299f8b9fc1254012b2a0b20c41bfb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agofeat(tests): Remove unsupported suites 67/40567/2
Vratko Polak [Thu, 21 Mar 2024 09:03:01 +0000 (10:03 +0100)]
feat(tests): Remove unsupported suites

The new suites were added in [1]
and the VPP functionality was removed in [2].

[1] https://gerrit.fd.io/r/c/csit/+/28508
[2] https://gerrit.fd.io/r/c/vpp/+/31443

Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agofix(report): Two more issues found so far 49/40549/2
Vratko Polak [Tue, 19 Mar 2024 15:56:42 +0000 (16:56 +0100)]
fix(report): Two more issues found so far

Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agojob-spec: Add DMA tests 57/40557/1
Tibor Frank [Wed, 20 Mar 2024 06:25:35 +0000 (06:25 +0000)]
job-spec: Add DMA tests

Change-Id: I6530519eaab2d09a187dddd803815888606ff17d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoUpdate VPP_STABLE_VER files 32/40432/2
Tibor Frank [Mon, 18 Mar 2024 05:33:05 +0000 (05:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agofeat(tests): Fix scaling of 6p3nic 13/40513/4 oper-240318
pmikus [Wed, 13 Mar 2024 14:24:47 +0000 (14:24 +0000)]
feat(tests): Fix scaling of 6p3nic

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271

7 weeks agofeat(report): Add currently known issues 11/40511/1
Vratko Polak [Wed, 13 Mar 2024 12:18:17 +0000 (13:18 +0100)]
feat(report): Add currently known issues

Analysis is not finished yet, some updates may arrive next week.

Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 weeks agoC-Dash: Add tooltips 01/40501/1
Tibor Frank [Tue, 12 Mar 2024 09:03:05 +0000 (09:03 +0000)]
C-Dash: Add tooltips

Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoC-Dash: add "download row data" feature to comparison tables 99/40499/2
Tibor Frank [Mon, 11 Mar 2024 12:00:34 +0000 (12:00 +0000)]
C-Dash: add "download row data" feature to comparison tables

Change-Id: Iaf5a57402e954453c237fb1e082da6c620cff59f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoC-Docs: Add a procedure to "Search tests". 96/40496/1
Tibor Frank [Mon, 11 Mar 2024 07:44:40 +0000 (07:44 +0000)]
C-Docs: Add a procedure to "Search tests".

Change-Id: I2b00894c6690cc1ae69d202f90fd9624c271832b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoUpdate VPP_STABLE_VER files 30/40430/2
Tibor Frank [Mon, 11 Mar 2024 05:58:58 +0000 (05:58 +0000)]
Update VPP_STABLE_VER files

Change-Id: I70dcb89767587e225bf2585349211953e6ac8713
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoC-Dash: Add possiblity to remove outliers from comparison data 66/40466/1
Tibor Frank [Thu, 7 Mar 2024 12:00:04 +0000 (12:00 +0000)]
C-Dash: Add possiblity to remove outliers from comparison data

- extreme outliers only for now

Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agoC-Docs: Update release information 53/40453/3
Tibor Frank [Mon, 4 Mar 2024 12:01:21 +0000 (12:01 +0000)]
C-Docs: Update release information

Change-Id: I77dbc422f502d0c342177598d30b3bcca7ea5e06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agofeat(ietf): MLRsearch draft-06 73/39773/11
Vratko Polak [Tue, 5 Mar 2024 12:25:39 +0000 (13:25 +0100)]
feat(ietf): MLRsearch draft-06

Change-Id: Ia9e22ba1eca74a32ae7141b1bd111bdb9baaddf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 weeks agofeat(device): cx6 update of 1n-alt device jobspec 30/40330/9
Juraj Linkeš [Mon, 12 Feb 2024 10:25:41 +0000 (11:25 +0100)]
feat(device): cx6 update of 1n-alt device jobspec

Update the jobspec according to the current Arm policy:
1. Run most of the tests on cx6, crypto coverage being the most
   important,
2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver,
3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf)
   drivers.

The above is the policy used in performance testing where time is a
major constraint. The same is true for functional testing to some
extent, so it makes sense to apply the same logic for choosing the tests.

There are 10 tests which are failing on cx6 without an identified
reason. They are disabled until we find the root cause and address it.
In the meantime, the tests are enabled for x710 with the DPDK driver:
ethip4-l2xcbase-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2tap
ethip4-l2bdbasemaclrn
ethip4-l2bdbasemaclrn-iacl1sf
ethip4-l2bdbasemaclrn-iacl1sl
ethip4-l2bdbasemaclrn-oacl1sf
ethip4-l2bdbasemaclrn-oacl1sl
ethip4-l2patch
ethip4-l2xcbase

When the cx6 issue has been resolved, these should be enabled for cx6
and disabled for x710, with the exception of ethip4-l2bdbasemaclrn,
which should be running on both.

Change-Id: Id48f450063e405b1faca57431676f91d62e829b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
8 weeks agoUpdate VPP_STABLE_VER files 23/40423/2
Tibor Frank [Mon, 4 Mar 2024 06:59:44 +0000 (06:59 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib84e4f147583c25c3fccff27a493dc07b37f7d9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Dash: Add search in tests 67/40367/16 oper-240304
Tibor Frank [Tue, 20 Feb 2024 11:04:48 +0000 (11:04 +0000)]
C-Dash: Add search in tests

Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agojob-spec: add more ip4scale tests to 2n-spr and 3na-spr 06/40406/2
Tibor Frank [Wed, 28 Feb 2024 05:58:03 +0000 (05:58 +0000)]
job-spec: add more ip4scale tests to 2n-spr and 3na-spr

Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 16/40416/2
Tibor Frank [Mon, 26 Feb 2024 05:55:38 +0000 (05:55 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9d6047a698c485e664f67bb4ea8847f683d0f688
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 14/40314/2 oper-240226
Tibor Frank [Mon, 19 Feb 2024 06:07:48 +0000 (06:07 +0000)]
Update VPP_STABLE_VER files

Change-Id: I84c7886a6181d24460665cd82ced2f83ced6f415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofeat(device): 1n-alt ansible improvement 56/40356/1 oper-240219
Juraj Linkeš [Fri, 16 Feb 2024 11:02:45 +0000 (12:02 +0100)]
feat(device): 1n-alt ansible improvement

We're seeing extra IGMP traffic which interferes with tests which must
be disabled. This is done by disabling the setting by default on all
interfaces.

The default setting is also adopted for other traffic-related
configuration:
Default sets the configuration when the interface is created. For
hardware interfaces, that is at boot time. For VF interfaces, when we
create them with the csit-initialize-vfs.sh script and for virtual
interfaces when they're created.
On the other hand, the all configuration option doesn't set the
configuration. It uses the current configuration value along with the
passed configuration value to produce a new value, which could be
expressed as:

f(old_value, value_from_all) -> new_value

Where f is a function specific to each configuration option. Using all
thus requires us to know the function and the old value which is less
reliable than just using default everywhere.

Also fix the 1n-alt VF init script.

Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 months agofeat(device): add cx6 to 1n-alt ansible 29/40329/2
Juraj Linkeš [Thu, 8 Feb 2024 12:10:30 +0000 (13:10 +0100)]
feat(device): add cx6 to 1n-alt ansible

Also update 1n-alt hardware with info from dmidecode and port names to
match the rules in Testbed Naming Convention.

Change-Id: Ib654adaec5667f0e79a3cb86edfbf4578f5c3d5f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 months agofix(core): daily jobs should not do prefixing 39/40339/1
pmikus [Thu, 15 Feb 2024 10:22:27 +0000 (10:22 +0000)]
fix(core): daily jobs should not do prefixing

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83

2 months agofix(bootstrap): typo 38/40338/2
pmikus [Thu, 15 Feb 2024 09:22:38 +0000 (10:22 +0100)]
fix(bootstrap): typo

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297

2 months agofix(core): Lower amount of TREX cores for external 34/40334/2
pmikus [Wed, 14 Feb 2024 10:09:27 +0000 (10:09 +0000)]
fix(core): Lower amount of TREX cores for external

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027

2 months agofeat(bootstrap): Add ability to load external NODE_FLAVOR 31/40331/1
pmikus [Tue, 13 Feb 2024 12:01:54 +0000 (13:01 +0100)]
feat(bootstrap): Add ability to load external NODE_FLAVOR

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75

2 months agofeat(core): QAT RXQ allocation 18/40318/5
pmikus [Wed, 7 Feb 2024 14:38:51 +0000 (15:38 +0100)]
feat(core): QAT RXQ allocation

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36

2 months agoUpdate VPP_STABLE_VER files 02/40302/2
Tibor Frank [Mon, 12 Feb 2024 06:19:06 +0000 (06:19 +0000)]
Update VPP_STABLE_VER files

Change-Id: I27030c7fed6afc0b7ea975f4a6a87d29571d48cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofix(bootstrap): skip suites for virtual NIC 17/40317/3
Vratko Polak [Wed, 7 Feb 2024 13:36:29 +0000 (14:36 +0100)]
fix(bootstrap): skip suites for virtual NIC

As the skipping logic looks at available topologies,
fix skipping by adding virtual to vagrant.yaml

Change-Id: I5e7bf1dc2f4f4787917f1f989a974255cf2591a9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoAdd memif with DMA test suites 46/39546/35
xinfengx [Thu, 21 Sep 2023 08:39:39 +0000 (08:39 +0000)]
Add memif with DMA test suites

Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2 months agoUpdate VPP_STABLE_VER files 01/40301/2
Tibor Frank [Mon, 5 Feb 2024 06:01:04 +0000 (06:01 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic982380b831d0092597136812def84e0a8b7dde5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 00/40300/2 oper-240205
Tibor Frank [Thu, 1 Feb 2024 11:42:00 +0000 (11:42 +0000)]
Update VPP_STABLE_VER files

Change-Id: I46a2f6669247b904570c7301854ec25fbb61cecf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofeat(job_specs): 2n-c7gn 79/40279/2
pmikus [Wed, 31 Jan 2024 11:19:47 +0000 (11:19 +0000)]
feat(job_specs): 2n-c7gn

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Idca0738320b56196e98aeec3050312111a90609a

3 months agofeat(terraform): 2n-c7gn 78/40278/2
pmikus [Wed, 31 Jan 2024 10:44:17 +0000 (10:44 +0000)]
feat(terraform): 2n-c7gn

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7a1f9744c4ca8abbd4814ab6cccba388ef466f50

3 months agofix(autogen): Do not set nic_code from nic_name 75/40275/3
Vratko Polak [Mon, 29 Jan 2024 14:11:20 +0000 (15:11 +0100)]
fix(autogen): Do not set nic_code from nic_name

This should fix some suites wrongly using nic_pfs=6.

Change-Id: Ifb7bd24b9a2d1764634eea4a43b4509f16e03da2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofeat(infra): SSH keys 76/40276/2
pmikus [Mon, 29 Jan 2024 14:46:08 +0000 (14:46 +0000)]
feat(infra): SSH keys

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia992a02b84450cd463b2fdce1d860d9133df6a55

3 months agoAdd ssh key for csit nomad host access 59/40259/2
Naveen Joy [Fri, 26 Jan 2024 21:30:48 +0000 (13:30 -0800)]
Add ssh key for csit nomad host access

Change-Id: I71f0139fb5dc2be7f32124e287929ceb0091fc9a
Signed-off-by: Naveen Joy <najoy@cisco.com>
3 months agoUpdate VPP_STABLE_VER files 75/40175/2
Tibor Frank [Mon, 29 Jan 2024 07:36:52 +0000 (07:36 +0000)]
Update VPP_STABLE_VER files

Change-Id: Iaa49c676d7b952a15eda428749d30aa47b7600c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoC-Dash: Add bandwidth to MRR iterative 56/40256/1
Tibor Frank [Fri, 26 Jan 2024 09:50:42 +0000 (09:50 +0000)]
C-Dash: Add bandwidth to MRR iterative

Change-Id: I86e4322796a47c952b3b248419b01a7fa2da12c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofeat(terraform): Migrating old structures 54/40254/2
pmikus [Thu, 25 Jan 2024 07:37:31 +0000 (07:37 +0000)]
feat(terraform): Migrating old structures

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib953739b4d34a7f803bff54cec92a2130fcbbc66

3 months agoC-Dash: Add 2402 data 25/40225/4 oper-rls2402-240125
Tibor Frank [Mon, 22 Jan 2024 10:03:54 +0000 (10:03 +0000)]
C-Dash: Add 2402 data

Change-Id: I5b5dba1525070e9d45322b453e441239a6069a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>