csit.git
18 hours agofeat(density): Delete ipsec nfv_density tests 19/40819/2 master
Vratko Polak [Thu, 25 Apr 2024 13:56:54 +0000 (15:56 +0200)]
feat(density): Delete ipsec nfv_density tests

They are broken for more than two years
and they relied on CLIs that changed in VPP anyway.

Ticket: CSIT-1856

Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
20 hours agofix(methodology): Update info for soak and ndrpdr 94/40794/2
Vratko Polak [Thu, 25 Apr 2024 11:39:05 +0000 (13:39 +0200)]
fix(methodology): Update info for soak and ndrpdr

Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 hours agojob-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd 93/40793/1
Tibor Frank [Thu, 25 Apr 2024 11:20:10 +0000 (11:20 +0000)]
job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I1e874ad107dd961e886e544f7d7017086523f894
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 hours agoC-Dash: Add soak tests 76/40776/6
Tibor Frank [Tue, 23 Apr 2024 12:04:13 +0000 (12:04 +0000)]
C-Dash: Add soak tests

Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736
Signed-off-by: Tibor Frank <tifrank@cisco.com>
23 hours agojob-spec: Add ipsec hw tests to 3n-snr and 3n-icxd 90/40790/2
Tibor Frank [Thu, 25 Apr 2024 05:51:25 +0000 (05:51 +0000)]
job-spec: Add ipsec hw tests to 3n-snr and 3n-icxd

Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
26 hours agofeat(profiles): Cleanup IPv6 profiles 91/40791/1
pmikus [Thu, 25 Apr 2024 05:49:13 +0000 (05:49 +0000)]
feat(profiles): Cleanup IPv6 profiles

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8

27 hours agoRevert "fix(ip6scale): Unify rnd profiles" 95/40695/2
Peter Mikus [Thu, 25 Apr 2024 05:00:58 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
27 hours agoRevert "fix(ip6scale): Unify rnd profiles" 94/40694/1
Peter Mikus [Thu, 25 Apr 2024 05:00:10 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"

This reverts commit b06f091ae65a7323231d84d188b863698169508b.

Reason for revert: .

Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
45 hours agofix(ip6scale): Unify rnd profiles 85/40785/1
Vratko Polak [Wed, 24 Apr 2024 11:11:27 +0000 (13:11 +0200)]
fix(ip6scale): Unify rnd profiles

Some were not even using STLVmFlowVarRepeatableRandom.

+ Simplify seed calculation.

Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 days agostyle(ipsec): add type hints to IPsecUtil 73/40773/2
Vratko Polak [Mon, 22 Apr 2024 15:59:42 +0000 (17:59 +0200)]
style(ipsec): add type hints to IPsecUtil

+ Update docstrings to match.

Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 days agofeat(etl): SOAK 77/40777/1
pmikus [Tue, 23 Apr 2024 12:31:32 +0000 (14:31 +0200)]
feat(etl): SOAK

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38

3 days agostyle(ipsec): Unify mutiline strings 70/40770/2
Vratko Polak [Mon, 22 Apr 2024 14:24:54 +0000 (16:24 +0200)]
style(ipsec): Unify mutiline strings

+ One more pylint improvement not worth a separate change.

Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 days agostyle(ipsec): Fix some issues reported by pylint 51/40751/2
Vratko Polak [Fri, 19 Apr 2024 08:50:21 +0000 (10:50 +0200)]
style(ipsec): Fix some issues reported by pylint

+ Fix typo "enale".
- Many style and complexity issues remain:
  C0302, R0904, R0914, R0913, R1735, R0915, R1734.

Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 days agoAdd hoststack with DMA test suites 16/39716/7
xinfengx [Thu, 19 Oct 2023 01:02:48 +0000 (01:02 +0000)]
Add hoststack with DMA test suites

Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
3 days agofix(ip6scale): Document correct prefix length 57/40757/1
Vratko Polak [Mon, 22 Apr 2024 08:52:32 +0000 (10:52 +0200)]
fix(ip6scale): Document correct prefix length

We are testing /128 in ip6 scale tests for a long time,
but we did not update the suite documentation when we switched.
This does that.
Note that ip6 bas (and feature) tests are still using /64.

Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 days agoUpdate VPP_STABLE_VER files 90/40690/2
Tibor Frank [Mon, 22 Apr 2024 04:04:28 +0000 (04:04 +0000)]
Update VPP_STABLE_VER files

Change-Id: If4175b67b34c96a097cbc7f250535159eef816be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 days agofeat(jobspec): Unify soak jobspecs 48/40748/2
Vratko Polak [Thu, 18 Apr 2024 12:45:29 +0000 (14:45 +0200)]
feat(jobspec): Unify soak jobspecs

Added 9 common tests (only one for non-default NIC+driver),
4 specific to nodeness (ASTF for 2-node, IPsec for 3-node).

+ First round, we can add more tests when duration is stable.
- Left TODOs for possible improvements.

Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 days agofeat(tests): IPv6 fixes 47/40747/2
pmikus [Thu, 18 Apr 2024 10:37:09 +0000 (10:37 +0000)]
feat(tests): IPv6 fixes

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f

7 days agofeat(job_specs): Add soak test 43/40743/6
pmikus [Wed, 17 Apr 2024 13:22:13 +0000 (13:22 +0000)]
feat(job_specs): Add soak test

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e

8 days agoRevert "fix(ip6): Use updated profile names in 2n suites" 83/40683/2
Peter Mikus [Thu, 18 Apr 2024 06:57:25 +0000 (06:57 +0000)]
Revert "fix(ip6): Use updated profile names in 2n suites"

This reverts commit b3c5215bba37bd6555231da8c40ae90d9fc570c9.

Reason for revert: Makes no sense

Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
8 days agofix(ipsec): Prepare IPsecUtil for upcoming changes 15/40715/4
Vratko Polak [Wed, 17 Apr 2024 08:52:33 +0000 (10:52 +0200)]
fix(ipsec): Prepare IPsecUtil for upcoming changes

+ Separate sad into two cycles.
+ Do not update flags in each iteration.
+ Update inner dicts.

Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agostyle(ipsec): Do not import ipsec.robot to suites 44/40744/2
Vratko Polak [Wed, 17 Apr 2024 15:26:56 +0000 (17:26 +0200)]
style(ipsec): Do not import ipsec.robot to suites

It is already available via default.robot import.

Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agofeat(tox): add copyright year fixer script 54/35154/15
Vratko Polak [Wed, 17 Apr 2024 15:24:24 +0000 (17:24 +0200)]
feat(tox): add copyright year fixer script

It uses rather simple sed commands, but seems to work well enough.

+ Improve readme.
+ Shortened comments about why 3 lines.

Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 days agofix(ip6): Use updated profile names in 2n suites 41/40741/2
Vratko Polak [Wed, 17 Apr 2024 12:49:59 +0000 (14:49 +0200)]
fix(ip6): Use updated profile names in 2n suites

Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 days agostyle(IPsecUtil): Apply black formatting 14/40714/1
Vratko Polak [Tue, 16 Apr 2024 11:58:58 +0000 (13:58 +0200)]
style(IPsecUtil): Apply black formatting

Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 days agofeat(api): Use newest API messages after rls2402 98/40698/7
Vratko Polak [Thu, 11 Apr 2024 16:24:03 +0000 (18:24 +0200)]
feat(api): Use newest API messages after rls2402

+ gtpu_add_del_tunnel_v2
 + Add comments on used values and unused fields.
+ ipsec_sad_entry_add_v2
 + Explicitly pass current default values.
+ ipsec_sa_v5_dump
+ policer_add
 + The old is_add argument removed, it was never false.
+ sr_policy_add_v2
 + Add comments about currently unused fields.
 + Support also older VP builds with wrong reply.
+ rdma_create_v4
 + Add comments about unused fields.

Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 days agoUpdate VPP_STABLE_VER files 81/40681/2
Tibor Frank [Mon, 15 Apr 2024 04:48:50 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: If792605aebeeedc722bc677b693be75858ac61e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 weeks agofeat(tests): IPv6 scale 24/40124/22
pmikus [Wed, 20 Dec 2023 13:28:36 +0000 (13:28 +0000)]
feat(tests): IPv6 scale

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I720b7c96a6ac9f328aff57437e51254364604911

2 weeks agofeat(job-spec): Unify memif 1518B tests for 2n-spr 73/40673/1
Vratko Polak [Wed, 10 Apr 2024 13:22:53 +0000 (15:22 +0200)]
feat(job-spec): Unify memif 1518B tests for 2n-spr

+ Add 4c 1518B tests to all memif 2n-spr coverage suites.
+ Add 1518B cases to iterative, so recently added DMA can be compared.

Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agofix(report): Update RCA 70/40670/1
Vratko Polak [Wed, 10 Apr 2024 10:34:02 +0000 (12:34 +0200)]
fix(report): Update RCA

Probably last update this cycle.
Few remamining failures were seen,
but they are probably too rare to reproduce.

Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agofix(perpatch): Sort comparison output by test name 59/40659/3
Vratko Polak [Tue, 9 Apr 2024 08:22:49 +0000 (10:22 +0200)]
fix(perpatch): Sort comparison output by test name

Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 weeks agoUpdate VPP_STABLE_VER files 76/40676/2
Tibor Frank [Mon, 8 Apr 2024 04:06:10 +0000 (04:06 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoFix(perpatch): improve compare script output 54/40654/1
Vratko Polak [Thu, 4 Apr 2024 11:01:47 +0000 (13:01 +0200)]
Fix(perpatch): improve compare script output

+ Make tests more searchable by "Test name" prefix.
+ Shorten the output code (fewer duplication and continues).

Change-Id: I0adfac146a689466345a30646e41fe948ea264ae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 weeks agojob-spec: Add memif DMA 1518B tests 48/40648/1
Tibor Frank [Wed, 3 Apr 2024 14:24:17 +0000 (14:24 +0000)]
job-spec: Add memif DMA 1518B tests

Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 weeks agoRevert "fix(topologies): Disable tb31 so jobs use tb32" 91/40591/2
Peter Mikus [Tue, 2 Apr 2024 06:56:08 +0000 (06:56 +0000)]
Revert "fix(topologies): Disable tb31 so jobs use tb32"

This reverts commit 2734517899b6c109da520e6aef0866c8b78ec708.

Reason for revert: not a proper solution, just hides an issue

Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817
Signed-off-by: Peter Mikus <pmikus@cisco.com>
3 weeks agoUpdate VPP_STABLE_VER files 82/40582/2
Tibor Frank [Tue, 2 Apr 2024 04:17:46 +0000 (04:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agofix(topologies): Disable tb31 so jobs use tb32 17/40617/1
Vratko Polak [Wed, 27 Mar 2024 14:15:20 +0000 (15:15 +0100)]
fix(topologies): Disable tb31 so jobs use tb32

As tb31 is the first reserved for 3n-icxd jobs,
most runs are currently failing due to CSIT-1951
(TwentyFiveGigabitEthernet89/0/2 does not do up).

Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofix(report): Update RCA for this week 16/40616/1
Vratko Polak [Wed, 27 Mar 2024 12:39:51 +0000 (13:39 +0100)]
fix(report): Update RCA for this week

Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofix(perpatch): Do not repeat test name 07/40507/3
Vratko Polak [Wed, 13 Mar 2024 13:00:46 +0000 (14:00 +0100)]
fix(perpatch): Do not repeat test name

When searching for a specific test,
it is confusing to see the name twice,
first time close to previous test classification.

Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
4 weeks agofix(terraform): vpp-device files 03/40603/2
pmikus [Mon, 25 Mar 2024 13:49:25 +0000 (14:49 +0100)]
fix(terraform): vpp-device files

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12

4 weeks agoUpdate VPP_STABLE_VER files 80/40580/3
Tibor Frank [Mon, 25 Mar 2024 12:49:48 +0000 (12:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: I32b3ae5beeeb42a6d4ccbe38d92b95c7803c2e01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
4 weeks agoRevert "fix(core): Disable core dbg analysis" 51/39551/18
Vratko Polak [Mon, 18 Mar 2024 14:43:12 +0000 (15:43 +0100)]
Revert "fix(core): Disable core dbg analysis"

This reverts commit ffca8b8655c772fc6273702cae2151e7ac7a846d.

+ Add 10 second sleep, could help if core is big.

Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agoC-Dash: Add detailed views to comparison tables 56/40556/6
Tibor Frank [Wed, 20 Mar 2024 05:43:03 +0000 (05:43 +0000)]
C-Dash: Add detailed views to comparison tables

Change-Id: I0936f736497299f8b9fc1254012b2a0b20c41bfb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agofeat(tests): Remove unsupported suites 67/40567/2
Vratko Polak [Thu, 21 Mar 2024 09:03:01 +0000 (10:03 +0100)]
feat(tests): Remove unsupported suites

The new suites were added in [1]
and the VPP functionality was removed in [2].

[1] https://gerrit.fd.io/r/c/csit/+/28508
[2] https://gerrit.fd.io/r/c/vpp/+/31443

Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agofix(report): Two more issues found so far 49/40549/2
Vratko Polak [Tue, 19 Mar 2024 15:56:42 +0000 (16:56 +0100)]
fix(report): Two more issues found so far

Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
5 weeks agojob-spec: Add DMA tests 57/40557/1
Tibor Frank [Wed, 20 Mar 2024 06:25:35 +0000 (06:25 +0000)]
job-spec: Add DMA tests

Change-Id: I6530519eaab2d09a187dddd803815888606ff17d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
5 weeks agoUpdate VPP_STABLE_VER files 32/40432/2
Tibor Frank [Mon, 18 Mar 2024 05:33:05 +0000 (05:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agofeat(tests): Fix scaling of 6p3nic 13/40513/4 oper-240318
pmikus [Wed, 13 Mar 2024 14:24:47 +0000 (14:24 +0000)]
feat(tests): Fix scaling of 6p3nic

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271

6 weeks agofeat(report): Add currently known issues 11/40511/1
Vratko Polak [Wed, 13 Mar 2024 12:18:17 +0000 (13:18 +0100)]
feat(report): Add currently known issues

Analysis is not finished yet, some updates may arrive next week.

Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
6 weeks agoC-Dash: Add tooltips 01/40501/1
Tibor Frank [Tue, 12 Mar 2024 09:03:05 +0000 (09:03 +0000)]
C-Dash: Add tooltips

Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoC-Dash: add "download row data" feature to comparison tables 99/40499/2
Tibor Frank [Mon, 11 Mar 2024 12:00:34 +0000 (12:00 +0000)]
C-Dash: add "download row data" feature to comparison tables

Change-Id: Iaf5a57402e954453c237fb1e082da6c620cff59f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoC-Docs: Add a procedure to "Search tests". 96/40496/1
Tibor Frank [Mon, 11 Mar 2024 07:44:40 +0000 (07:44 +0000)]
C-Docs: Add a procedure to "Search tests".

Change-Id: I2b00894c6690cc1ae69d202f90fd9624c271832b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
6 weeks agoUpdate VPP_STABLE_VER files 30/40430/2
Tibor Frank [Mon, 11 Mar 2024 05:58:58 +0000 (05:58 +0000)]
Update VPP_STABLE_VER files

Change-Id: I70dcb89767587e225bf2585349211953e6ac8713
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoC-Dash: Add possiblity to remove outliers from comparison data 66/40466/1
Tibor Frank [Thu, 7 Mar 2024 12:00:04 +0000 (12:00 +0000)]
C-Dash: Add possiblity to remove outliers from comparison data

- extreme outliers only for now

Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agoC-Docs: Update release information 53/40453/3
Tibor Frank [Mon, 4 Mar 2024 12:01:21 +0000 (12:01 +0000)]
C-Docs: Update release information

Change-Id: I77dbc422f502d0c342177598d30b3bcca7ea5e06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
7 weeks agofeat(ietf): MLRsearch draft-06 73/39773/11
Vratko Polak [Tue, 5 Mar 2024 12:25:39 +0000 (13:25 +0100)]
feat(ietf): MLRsearch draft-06

Change-Id: Ia9e22ba1eca74a32ae7141b1bd111bdb9baaddf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 weeks agofeat(device): cx6 update of 1n-alt device jobspec 30/40330/9
Juraj Linkeš [Mon, 12 Feb 2024 10:25:41 +0000 (11:25 +0100)]
feat(device): cx6 update of 1n-alt device jobspec

Update the jobspec according to the current Arm policy:
1. Run most of the tests on cx6, crypto coverage being the most
   important,
2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver,
3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf)
   drivers.

The above is the policy used in performance testing where time is a
major constraint. The same is true for functional testing to some
extent, so it makes sense to apply the same logic for choosing the tests.

There are 10 tests which are failing on cx6 without an identified
reason. They are disabled until we find the root cause and address it.
In the meantime, the tests are enabled for x710 with the DPDK driver:
ethip4-l2xcbase-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2tap
ethip4-l2bdbasemaclrn
ethip4-l2bdbasemaclrn-iacl1sf
ethip4-l2bdbasemaclrn-iacl1sl
ethip4-l2bdbasemaclrn-oacl1sf
ethip4-l2bdbasemaclrn-oacl1sl
ethip4-l2patch
ethip4-l2xcbase

When the cx6 issue has been resolved, these should be enabled for cx6
and disabled for x710, with the exception of ethip4-l2bdbasemaclrn,
which should be running on both.

Change-Id: Id48f450063e405b1faca57431676f91d62e829b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
7 weeks agoUpdate VPP_STABLE_VER files 23/40423/2
Tibor Frank [Mon, 4 Mar 2024 06:59:44 +0000 (06:59 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib84e4f147583c25c3fccff27a493dc07b37f7d9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agoC-Dash: Add search in tests 67/40367/16 oper-240304
Tibor Frank [Tue, 20 Feb 2024 11:04:48 +0000 (11:04 +0000)]
C-Dash: Add search in tests

Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agojob-spec: add more ip4scale tests to 2n-spr and 3na-spr 06/40406/2
Tibor Frank [Wed, 28 Feb 2024 05:58:03 +0000 (05:58 +0000)]
job-spec: add more ip4scale tests to 2n-spr and 3na-spr

Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 weeks agoUpdate VPP_STABLE_VER files 16/40416/2
Tibor Frank [Mon, 26 Feb 2024 05:55:38 +0000 (05:55 +0000)]
Update VPP_STABLE_VER files

Change-Id: I9d6047a698c485e664f67bb4ea8847f683d0f688
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 14/40314/2 oper-240226
Tibor Frank [Mon, 19 Feb 2024 06:07:48 +0000 (06:07 +0000)]
Update VPP_STABLE_VER files

Change-Id: I84c7886a6181d24460665cd82ced2f83ced6f415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofeat(device): 1n-alt ansible improvement 56/40356/1 oper-240219
Juraj Linkeš [Fri, 16 Feb 2024 11:02:45 +0000 (12:02 +0100)]
feat(device): 1n-alt ansible improvement

We're seeing extra IGMP traffic which interferes with tests which must
be disabled. This is done by disabling the setting by default on all
interfaces.

The default setting is also adopted for other traffic-related
configuration:
Default sets the configuration when the interface is created. For
hardware interfaces, that is at boot time. For VF interfaces, when we
create them with the csit-initialize-vfs.sh script and for virtual
interfaces when they're created.
On the other hand, the all configuration option doesn't set the
configuration. It uses the current configuration value along with the
passed configuration value to produce a new value, which could be
expressed as:

f(old_value, value_from_all) -> new_value

Where f is a function specific to each configuration option. Using all
thus requires us to know the function and the old value which is less
reliable than just using default everywhere.

Also fix the 1n-alt VF init script.

Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 months agofeat(device): add cx6 to 1n-alt ansible 29/40329/2
Juraj Linkeš [Thu, 8 Feb 2024 12:10:30 +0000 (13:10 +0100)]
feat(device): add cx6 to 1n-alt ansible

Also update 1n-alt hardware with info from dmidecode and port names to
match the rules in Testbed Naming Convention.

Change-Id: Ib654adaec5667f0e79a3cb86edfbf4578f5c3d5f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
2 months agofix(core): daily jobs should not do prefixing 39/40339/1
pmikus [Thu, 15 Feb 2024 10:22:27 +0000 (10:22 +0000)]
fix(core): daily jobs should not do prefixing

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83

2 months agofix(bootstrap): typo 38/40338/2
pmikus [Thu, 15 Feb 2024 09:22:38 +0000 (10:22 +0100)]
fix(bootstrap): typo

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297

2 months agofix(core): Lower amount of TREX cores for external 34/40334/2
pmikus [Wed, 14 Feb 2024 10:09:27 +0000 (10:09 +0000)]
fix(core): Lower amount of TREX cores for external

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic27f46876a93cc01d5f14bbefe0dccd84ab41027

2 months agofeat(bootstrap): Add ability to load external NODE_FLAVOR 31/40331/1
pmikus [Tue, 13 Feb 2024 12:01:54 +0000 (13:01 +0100)]
feat(bootstrap): Add ability to load external NODE_FLAVOR

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ia6e07111af543280b2365840bced02f94cf91e75

2 months agofeat(core): QAT RXQ allocation 18/40318/5
pmikus [Wed, 7 Feb 2024 14:38:51 +0000 (15:38 +0100)]
feat(core): QAT RXQ allocation

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I78501f08b29a202c0e1129b79af6a63299e8ee36

2 months agoUpdate VPP_STABLE_VER files 02/40302/2
Tibor Frank [Mon, 12 Feb 2024 06:19:06 +0000 (06:19 +0000)]
Update VPP_STABLE_VER files

Change-Id: I27030c7fed6afc0b7ea975f4a6a87d29571d48cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofix(bootstrap): skip suites for virtual NIC 17/40317/3
Vratko Polak [Wed, 7 Feb 2024 13:36:29 +0000 (14:36 +0100)]
fix(bootstrap): skip suites for virtual NIC

As the skipping logic looks at available topologies,
fix skipping by adding virtual to vagrant.yaml

Change-Id: I5e7bf1dc2f4f4787917f1f989a974255cf2591a9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agoAdd memif with DMA test suites 46/39546/35
xinfengx [Thu, 21 Sep 2023 08:39:39 +0000 (08:39 +0000)]
Add memif with DMA test suites

Change-Id: I8c27b5956c0c26bb2de48321675e285ed961412f
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
2 months agoUpdate VPP_STABLE_VER files 01/40301/2
Tibor Frank [Mon, 5 Feb 2024 06:01:04 +0000 (06:01 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic982380b831d0092597136812def84e0a8b7dde5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 00/40300/2 oper-240205
Tibor Frank [Thu, 1 Feb 2024 11:42:00 +0000 (11:42 +0000)]
Update VPP_STABLE_VER files

Change-Id: I46a2f6669247b904570c7301854ec25fbb61cecf
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agofeat(job_specs): 2n-c7gn 79/40279/2
pmikus [Wed, 31 Jan 2024 11:19:47 +0000 (11:19 +0000)]
feat(job_specs): 2n-c7gn

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Idca0738320b56196e98aeec3050312111a90609a

2 months agofeat(terraform): 2n-c7gn 78/40278/2
pmikus [Wed, 31 Jan 2024 10:44:17 +0000 (10:44 +0000)]
feat(terraform): 2n-c7gn

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7a1f9744c4ca8abbd4814ab6cccba388ef466f50

2 months agofix(autogen): Do not set nic_code from nic_name 75/40275/3
Vratko Polak [Mon, 29 Jan 2024 14:11:20 +0000 (15:11 +0100)]
fix(autogen): Do not set nic_code from nic_name

This should fix some suites wrongly using nic_pfs=6.

Change-Id: Ifb7bd24b9a2d1764634eea4a43b4509f16e03da2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
2 months agofeat(infra): SSH keys 76/40276/2
pmikus [Mon, 29 Jan 2024 14:46:08 +0000 (14:46 +0000)]
feat(infra): SSH keys

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ia992a02b84450cd463b2fdce1d860d9133df6a55

2 months agoAdd ssh key for csit nomad host access 59/40259/2
Naveen Joy [Fri, 26 Jan 2024 21:30:48 +0000 (13:30 -0800)]
Add ssh key for csit nomad host access

Change-Id: I71f0139fb5dc2be7f32124e287929ceb0091fc9a
Signed-off-by: Naveen Joy <najoy@cisco.com>
2 months agoUpdate VPP_STABLE_VER files 75/40175/2
Tibor Frank [Mon, 29 Jan 2024 07:36:52 +0000 (07:36 +0000)]
Update VPP_STABLE_VER files

Change-Id: Iaa49c676d7b952a15eda428749d30aa47b7600c6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 months agoC-Dash: Add bandwidth to MRR iterative 56/40256/1
Tibor Frank [Fri, 26 Jan 2024 09:50:42 +0000 (09:50 +0000)]
C-Dash: Add bandwidth to MRR iterative

Change-Id: I86e4322796a47c952b3b248419b01a7fa2da12c7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofeat(terraform): Migrating old structures 54/40254/2
pmikus [Thu, 25 Jan 2024 07:37:31 +0000 (07:37 +0000)]
feat(terraform): Migrating old structures

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib953739b4d34a7f803bff54cec92a2130fcbbc66

3 months agoC-Dash: Add 2402 data 25/40225/4 oper-rls2402-240125
Tibor Frank [Mon, 22 Jan 2024 10:03:54 +0000 (10:03 +0000)]
C-Dash: Add 2402 data

Change-Id: I5b5dba1525070e9d45322b453e441239a6069a03
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofix(PLRsearch): handle unsent packets as loss 89/40189/8
Vratko Polak [Wed, 24 Jan 2024 09:14:43 +0000 (10:14 +0100)]
fix(PLRsearch): handle unsent packets as loss

Change-Id: Icaa88523ede0b1fad6e6cb667a8f307ea5f4a12d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofix(PLRsearch): fix some pylint violations 88/40188/4
Vratko Polak [Fri, 12 Jan 2024 13:51:43 +0000 (14:51 +0100)]
fix(PLRsearch): fix some pylint violations

- Complexity and logging would require a larger change.

Change-Id: I69f8e47b1806c880cd626bc5a8f5ae6290246093
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agostyle(PLRsearch): format according to black 87/40187/4
Vratko Polak [Fri, 12 Jan 2024 13:50:52 +0000 (14:50 +0100)]
style(PLRsearch): format according to black

Change-Id: I26e0ce172740f7f440469578294f8c13fec5850b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofeat(PyPI): update metadata for jumpavg 0.4.2 43/40243/2
Vratko Polak [Tue, 23 Jan 2024 14:37:14 +0000 (15:37 +0100)]
feat(PyPI): update metadata for jumpavg 0.4.2

+ Convert readme to .rst
+ Add Usage including a basic example.
 - Detailed description points to C-DASH methodology.
 + That page is updated for new defaults and better description.
+ Unify readme layout and origins with MLRsearch metadata.
 - Not releasing new MLRsearch version just for readme improvements.
+ Update the TODO file.

Change-Id: I76ac22b7f283f01349bf9a50459dc841e13b21ad
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agoUpdate VPP_STABLE_VER files 61/40161/4 oper-240124
Tibor Frank [Mon, 22 Jan 2024 05:40:52 +0000 (05:40 +0000)]
Update VPP_STABLE_VER files

Change-Id: I2ef48078c9fbcec2113417e4e9db3103596c45f1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofeat(infra): 1n-alt 39/40239/1
pmikus [Tue, 23 Jan 2024 10:00:56 +0000 (10:00 +0000)]
feat(infra): 1n-alt

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Iea69bcd730f641504428f1400e5c6eb6d6b755dd

3 months agodocs(infra): 1n-alt 38/40238/4
pmikus [Tue, 23 Jan 2024 07:43:15 +0000 (07:43 +0000)]
docs(infra): 1n-alt

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I1770a3f49e19d337d4ed6760fb062ba4d445574d

3 months agofeat(device): Add 1n-alt vpp device 05/40205/4
pmikus [Wed, 17 Jan 2024 11:45:05 +0000 (11:45 +0000)]
feat(device): Add 1n-alt vpp device

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I3d2bb0408f15fd14989d1179d7f08710a3d86e67

3 months agofix(jumpavg): Tolerate zero sized runs 30/40230/2
Vratko Polak [Mon, 22 Jan 2024 16:58:22 +0000 (17:58 +0100)]
fix(jumpavg): Tolerate zero sized runs

Change-Id: I7c2426fe47ca9ee44338423597be90a71aaa3653
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofeat(bisect): Tolerate zero tests 27/40227/2
Vratko Polak [Mon, 22 Jan 2024 16:57:30 +0000 (17:57 +0100)]
feat(bisect): Tolerate zero tests

Needed when the anomaly causes failure in the global suite setup.
Also needs a jumpavg fix, in the subsequent change.

Change-Id: Ifa8f8fcfc0b25416afa064e606a59b79aa279b61
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofeat(papi): Tolerate behavior after 39871 28/40228/3
Vratko Polak [Mon, 22 Jan 2024 14:33:55 +0000 (15:33 +0100)]
feat(papi): Tolerate behavior after 39871

Even when VPP switches back to (or adds support for) the old behavior,
this enables bisect to work for all VPP commits in 2402 cycle.

Change-Id: Ic2b71bee1db723d9d13229d9f4288d1699d246c6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofeat(pxe): 1n-alt 26/40226/3
pmikus [Mon, 22 Jan 2024 10:29:49 +0000 (10:29 +0000)]
feat(pxe): 1n-alt

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I476f10bf8f487c5fdb6d2a091af8db62ed9015d7

3 months agoC-Dash: fix the date 23/40223/1
Tibor Frank [Mon, 22 Jan 2024 08:53:52 +0000 (08:53 +0000)]
C-Dash: fix the date

Change-Id: I731f74ff09ad7ccad7113bc36acfc3f8f583f05d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoinfra: Set terraform version to 1.4.2 22/40222/1
Tibor Frank [Mon, 22 Jan 2024 08:34:12 +0000 (08:34 +0000)]
infra: Set terraform version to 1.4.2

Change-Id: Id9ba6b459938772c7e63290f8b093b3d501e3958
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agoC-Dash: Add rls2402 content 21/40221/1
Tibor Frank [Mon, 22 Jan 2024 08:25:50 +0000 (08:25 +0000)]
C-Dash: Add rls2402 content

Change-Id: Ib75a4b5309c2e793ef1231abdee30e01304a44c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
3 months agofeat(crc): Bump messages after 23.10 release 09/40209/4 oper-240122
Vratko Polak [Thu, 18 Jan 2024 14:14:07 +0000 (15:14 +0100)]
feat(crc): Bump messages after 23.10 release

+ Post-release rdma_create_v4 will be added next cycle.

Change-Id: Ief129b5be4a2c5d27f4674491c96c548573ecfb1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
3 months agofeat(terraform): Migrate C-DASH to M7g.2xlarge 15/40115/6
pmikus [Fri, 15 Dec 2023 11:18:19 +0000 (11:18 +0000)]
feat(terraform): Migrate C-DASH to M7g.2xlarge

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Idc39227487a89b7e637c8e2193be27fae088322d