csit.git
8 months agofix(core): Requirements bump 12/41412/1
pmikus [Wed, 14 Aug 2024 10:29:21 +0000 (12:29 +0200)]
fix(core): Requirements bump

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I123295851d6d8a8bdfcf8fd0d3e68de8aad38965

8 months agofeat(report): Finalize RCA edits to release notes 05/41405/1
Vratko Polak [Mon, 12 Aug 2024 13:49:40 +0000 (15:49 +0200)]
feat(report): Finalize RCA edits to release notes

Change-Id: I4155d027e8a991a9857d1dd8703c5c28726ec4be
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 months agoUpdate VPP_STABLE_VER files 36/41436/2
Tibor Frank [Mon, 12 Aug 2024 04:52:01 +0000 (04:52 +0000)]
Update VPP_STABLE_VER files

Change-Id: Idd05f08c8d1af014676405d62f8c44a187339ee6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 months agofix(papi): do not check client in async 02/41402/1
Vratko Polak [Fri, 9 Aug 2024 12:32:58 +0000 (14:32 +0200)]
fix(papi): do not check client in async

This is primarily to avoid excessive logging
in scenarios with multiple get_replies (not just .add) per session.

Change-Id: Ic5b1c295965cd8d32c71a7851ec7823568483b06
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 months agofix(papi): Do not check CRC on None 64/41364/2
Vratko Polak [Wed, 7 Aug 2024 11:02:54 +0000 (13:02 +0200)]
fix(papi): Do not check CRC on None

None can happen when VPP crashes
(and pipe is not detected as broken yet) or stalls.
Avoid CRC check in that case, raise early with error message.

Change-Id: I15a957420320affd72dbd99fa48c309b28f0511a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 months agofix(pip): Requirements for 24.04 73/41373/1
pmikus [Wed, 7 Aug 2024 06:53:06 +0000 (08:53 +0200)]
fix(pip): Requirements for 24.04

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I7511fb128d81f5d91fb2cc0d71f193efaefd9f41

8 months agoUpdate VPP_STABLE_VER files 23/41323/2
Tibor Frank [Mon, 5 Aug 2024 06:26:08 +0000 (06:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ifbb1a34ebae5d8f1759c112b496d24b084948e5f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
8 months agofeat(ebs): Install hugo if not found 51/41351/2 oper-240805
pmikus [Thu, 1 Aug 2024 11:15:13 +0000 (13:15 +0200)]
feat(ebs): Install hugo if not found

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ice4c09579a174c0ce3d26c8429016d55414bfb93

8 months agofeat(bootstrap): Split gather.sh 45/41345/1
pmikus [Wed, 31 Jul 2024 13:30:40 +0000 (15:30 +0200)]
feat(bootstrap): Split gather.sh

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I8bf1fbf49d224b89f2da4a7f08bdf932cad9fd35

8 months agofeat(ansible): env variables for nomad and vault 40/41340/1
pmikus [Wed, 31 Jul 2024 09:10:19 +0000 (11:10 +0200)]
feat(ansible): env variables for nomad and vault

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I8a27c6ae832237947db6d28c052af0d15cac19a0

8 months agofeat(job_specs): Update 1n-spr 38/41338/1
pmikus [Wed, 31 Jul 2024 07:49:01 +0000 (09:49 +0200)]
feat(job_specs): Update 1n-spr

Due to upgrade of ubuntu 24.04 the E810 stopped working.
To be investigated.

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Iee7ede4ba4377af114be7cce0a5e9c63865cd8dc

8 months agofeat(infra): Ubuntu 24.04 LTS 12/41312/5
pmikus [Tue, 30 Jul 2024 12:46:46 +0000 (14:46 +0200)]
feat(infra): Ubuntu 24.04 LTS

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7d672d07e6ed6bf6582888e8826bbc1cb6d94d17

8 months agofix(report): Update iterative failures in notes 08/41308/2
Vratko Polak [Mon, 29 Jul 2024 12:30:28 +0000 (14:30 +0200)]
fix(report): Update iterative failures in notes

Only VPP-2118 is really new.
Other "new" tickets are older issues,
either separated from similar symptoms,
or uncovered by recent CSIT suite edits.
Or reopened, when previous workarounds
did not reduce frequency enough.

- Not investigated which known iterative issues were fixed, yet.

Change-Id: Ic06c5ae80b933bfbc56c775d76be25dbcfa88a9e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
8 months agofeat(job_spec): vpp_device 09/41309/1
pmikus [Mon, 29 Jul 2024 12:55:35 +0000 (14:55 +0200)]
feat(job_spec): vpp_device

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I0b2eeea045fe241129f978ec96eec5c0c5bc9938

8 months agofeat(infra): Ubuntu 24.04 LTS 02/41302/5
pmikus [Fri, 26 Jul 2024 12:02:11 +0000 (14:02 +0200)]
feat(infra): Ubuntu 24.04 LTS

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib1f079f7fecb0c1f0f477bc565205165295202bd

8 months agofeat(terraform): Update ETL 04/41304/3
pmikus [Mon, 29 Jul 2024 09:37:55 +0000 (11:37 +0200)]
feat(terraform): Update ETL

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I840cbc5a95e9af41af1811fc28db71e6b0d19d1e

8 months agoUpdate VPP_STABLE_VER files 16/41316/2
Tibor Frank [Mon, 29 Jul 2024 06:01:56 +0000 (06:01 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ice8eb6ede5131bc82f11446884eeab4e58106636
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(TGen): Include reason on TRex error 93/41293/3
Vratko Polak [Wed, 24 Jul 2024 11:56:57 +0000 (13:56 +0200)]
feat(TGen): Include reason on TRex error

This adds noise to console output,
but prevents other possible bugs
from looking just like CSIT-1936.

Ticket: CSIT-1936

Change-Id: If30c59a96ebd9cec6aea40ca820b775d5f3548c6
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agofix(container): Remove obsolete LXC option 90/41290/2
Vratko Polak [Tue, 23 Jul 2024 11:26:30 +0000 (13:26 +0200)]
fix(container): Remove obsolete LXC option

CSIT-1944

Change-Id: I0f763369acc560a5ab2d9db28fc25f20b1c5ffe7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agofeat(infra): Ubuntu 24.04 LTS 84/41284/6
pmikus [Mon, 22 Jul 2024 11:51:10 +0000 (13:51 +0200)]
feat(infra): Ubuntu 24.04 LTS

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I81e48360fcc970a16f1203955003d59f476b3233

9 months agoC-Dash: Update python packages to the newest versions 01/41301/1
Tibor Frank [Fri, 26 Jul 2024 07:05:10 +0000 (07:05 +0000)]
C-Dash: Update python packages to the newest versions

Change-Id: Ieb8bcd85c1cede2ec203075f8dd3208ac3115110
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate requirements to the newest versions 00/41300/3
Tibor Frank [Thu, 25 Jul 2024 11:07:31 +0000 (11:07 +0000)]
Update requirements to the newest versions

Change-Id: I2eea5996c799e06cda73ab79ae2123867a913106
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 33/41233/2
Tibor Frank [Mon, 22 Jul 2024 05:06:22 +0000 (05:06 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ica1c8da6ee01e27b1fa0673a46015bed34d1a106
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(ietf): MLRsearch draft-07 45/41245/32
Vratko Polak [Wed, 17 Jul 2024 18:12:47 +0000 (20:12 +0200)]
feat(ietf): MLRsearch draft-07

+ date change 17jul to 18jul due to ietf submission tool reqs
+ .xml and .txt

Change-Id: I8b6fbba3a412ce41773b73592722905a9f361861
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
9 months agofix(api): Remove support for old behaviors 78/41278/2
Vratko Polak [Fri, 19 Jul 2024 08:14:49 +0000 (10:14 +0200)]
fix(api): Remove support for old behaviors

The 2406 cycle did not upgrade any messages used by CSIT.
But there were few workarounds in CSIT code
to accomodate vehavior of older VPP builds.
Two removed.
One (re PAPI) stays, as that needs more testing.

Change-Id: I0595cf1d8b9d9ea80113f59130cbbdf00a249157
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agofeat(ansible): Update calibration role 76/41276/1
pmikus [Thu, 18 Jul 2024 07:28:11 +0000 (09:28 +0200)]
feat(ansible): Update calibration role

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: If09928efb26066137014d3784efc6e6910d01143

9 months agoC-Dash: Make extraction of topo-arch more flexible 64/41264/2
Tibor Frank [Tue, 16 Jul 2024 09:33:26 +0000 (09:33 +0000)]
C-Dash: Make extraction of topo-arch more flexible

Change-Id: I5f59a881d6c23c3e40054a6d829abdcbcafb966b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofix(bootstrap): External topologies read" 71/41271/1
pmikus [Wed, 17 Jul 2024 05:59:41 +0000 (07:59 +0200)]
fix(bootstrap): External topologies read"

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Iefa96896004d8c9cc06df90f0a744c497b443106

9 months agofeat(core): Change external testbed detection" 66/41266/2
pmikus [Tue, 16 Jul 2024 11:49:01 +0000 (13:49 +0200)]
feat(core): Change external testbed detection"

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Id005feac8104bb0b7da08d8dd9baaa3c5117e157

9 months agojob-spec: Add imix and 1518B framesizes to ip4scale60k 65/41265/1
Tibor Frank [Tue, 16 Jul 2024 09:50:49 +0000 (09:50 +0000)]
job-spec: Add imix and 1518B framesizes to ip4scale60k

Change-Id: I498540140965ecec70390e0b13c2418a31cf1dc8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 26/41226/2
Tibor Frank [Mon, 15 Jul 2024 04:59:18 +0000 (04:59 +0000)]
Update VPP_STABLE_VER files

Change-Id: I201e10cf95a80777b0b4eafc50c96093c1f5c878
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofeat(report): Prepare 2406 known issues 95/41195/2
Vratko Polak [Wed, 10 Jul 2024 11:13:53 +0000 (13:13 +0200)]
feat(report): Prepare 2406 known issues

- Few performance changes uncovered by edits to CSIT suites
  still need to be documented.

Change-Id: I2573d4719141fb8792a2a59171784761a87a6303
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
9 months agoC-Docs: Modify URLs to examples in rls notes 51/41251/1
Tibor Frank [Wed, 10 Jul 2024 09:44:24 +0000 (09:44 +0000)]
C-Docs: Modify URLs to examples in rls notes

Change-Id: Icb2ddf8bba494ee9290485c994bd100ab3e4ca70
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 21/41221/2
Tibor Frank [Mon, 8 Jul 2024 05:20:42 +0000 (05:20 +0000)]
Update VPP_STABLE_VER files

Change-Id: I119b41a8a81ccec3b025c5fc17f98d33e1a3290f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agoUpdate VPP_STABLE_VER files 20/41220/2 oper-240708
Tibor Frank [Mon, 1 Jul 2024 04:20:51 +0000 (04:20 +0000)]
Update VPP_STABLE_VER files

Change-Id: I99a78bb03722048fb4c69a78f8cfbad2a50e6bb2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
9 months agofix(core): VPP Initialisation issue on MLX. 90/41190/12 oper-240701
pmikus [Wed, 26 Jun 2024 09:05:51 +0000 (11:05 +0200)]
fix(core): VPP Initialisation issue on MLX.

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I2113e5e2067e13465ee1fedc6a2ba1c5bc1d7254

10 months agoC-Dash: URLs to jobs and builds 89/41189/2
Tibor Frank [Wed, 26 Jun 2024 08:03:21 +0000 (08:03 +0000)]
C-Dash: URLs to jobs and builds

Change-Id: I468c626e8f552d0cb4c35756f9f632f1f907fb0a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(core): typo 84/41184/1
pmikus [Tue, 25 Jun 2024 10:02:40 +0000 (12:02 +0200)]
fix(core): typo

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I8ae87a8ee350cfe601a9deab2f115b75d26bd02a

10 months agofeat(core): Add option to disable sriov check 83/41183/1
pmikus [Tue, 25 Jun 2024 08:51:59 +0000 (10:51 +0200)]
feat(core): Add option to disable sriov check

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: Ie8dbdf8b231dcbbbf2c90ad0f16d6b48fbdd8c5c

10 months agoC-Dash: fix telemetry 79/41179/2
Tibor Frank [Mon, 24 Jun 2024 11:59:56 +0000 (11:59 +0000)]
C-Dash: fix telemetry

Change-Id: Ic30b27e0defd91ab2fdc979569485d9f9a01e78b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoC-Dash: fix in test job statistics 77/41177/2
Tibor Frank [Mon, 24 Jun 2024 08:49:16 +0000 (08:49 +0000)]
C-Dash: fix in test job statistics

Change-Id: I290b3d01f578a2809cf3b89fe91faa51b6dc2522
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 29/41129/2
Tibor Frank [Mon, 24 Jun 2024 06:51:13 +0000 (06:51 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1f3ef31ba276dfd4b0c9b1524939920aad9a3d79
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoC-Dash: Make possible to read data from only one parquet 75/41175/3
Tibor Frank [Mon, 24 Jun 2024 06:43:51 +0000 (06:43 +0000)]
C-Dash: Make possible to read data from only one parquet

Change-Id: Ifa72b520d6d0dbf9f39432f84a94ab93589a4079
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(core): Adjust T-Rex for external topologies 54/41154/2
pmikus [Tue, 18 Jun 2024 09:19:25 +0000 (11:19 +0200)]
feat(core): Adjust T-Rex for external topologies

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Id3f0a4a26404951bc7ce82655538b72848508e18

10 months agoC-Dash: Add mrr trials to hover and detailed info 53/41153/2
Tibor Frank [Tue, 18 Jun 2024 08:16:30 +0000 (08:16 +0000)]
C-Dash: Add mrr trials to hover and detailed info

Change-Id: Ic26cd2aa726f16b3797c269b31e5ad127bbea5b2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(trex): Add MTU 49/41149/3
pmikus [Mon, 17 Jun 2024 12:44:03 +0000 (14:44 +0200)]
fix(trex): Add MTU

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I91a3136a29192fb25ec4845e0924b96977f591f5

10 months agoUpdate VPP_STABLE_VER files 24/41124/2
Tibor Frank [Mon, 17 Jun 2024 05:44:07 +0000 (05:44 +0000)]
Update VPP_STABLE_VER files

Change-Id: I30ff178bda25342a0fd12e060c5e67ae889f2767
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix: Show mrr trials in trending graphs 12/41112/1
Tibor Frank [Wed, 12 Jun 2024 13:36:25 +0000 (13:36 +0000)]
fix: Show mrr trials in trending graphs

Change-Id: If5003d4fb718dc1bf76cb6e049b00783e03de8bb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoC-Dash: Show mrr trials in trending graphs 08/41108/5
Tibor Frank [Tue, 11 Jun 2024 12:31:21 +0000 (12:31 +0000)]
C-Dash: Show mrr trials in trending graphs

Change-Id: I5b983aa249dd5ac62f78e6f980ab81f270234b0f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(multi): Multiple VPP instances 42/40742/12
pmikus [Wed, 17 Apr 2024 12:27:25 +0000 (12:27 +0000)]
feat(multi): Multiple VPP instances

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I28f2752f725c9816a557667033bf7d656fb0d414

10 months agofeat(ansible): Repurpose obsolete vpp-device 92/41092/2
pmikus [Fri, 7 Jun 2024 05:02:11 +0000 (07:02 +0200)]
feat(ansible): Repurpose obsolete vpp-device

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I95171ab59dfe1b5a98c36a839233d14e9ddb7ce5

10 months agoUpdate VPP_STABLE_VER files 68/41068/2
Tibor Frank [Mon, 10 Jun 2024 06:01:14 +0000 (06:01 +0000)]
Update VPP_STABLE_VER files

Change-Id: Id2535d02d103db58888dac7733d5aded1e7c5d78
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(release): Update VPP release notes 35/40935/5 oper-240610
Vratko Polak [Tue, 4 Jun 2024 11:43:28 +0000 (13:43 +0200)]
feat(release): Update VPP release notes

+ List added and edited perf tests.
+ List new device NICs and tests on them.
 + Copy known device issues, even thougth new jobspecs avoid them.

Change-Id: I3e791c6d6395a4d9ac720fb0c9291464cf6d7395
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofix(jobspec): IPsec HWasync has 1c, not 3c 34/41034/1
Vratko Polak [Tue, 4 Jun 2024 11:54:02 +0000 (13:54 +0200)]
fix(jobspec): IPsec HWasync has 1c, not 3c

Fixes: d29977e35bb15cd7df21c082432f03eab87e2e66

Change-Id: I1a20ded1181f5a3b33a0f6640554a939218d9791
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoC-Docs: Add env ver 15 33/41033/1
Tibor Frank [Tue, 4 Jun 2024 09:35:54 +0000 (09:35 +0000)]
C-Docs: Add env ver 15

Change-Id: I53d24a291907c862e2214e9152cede8f0ac05345
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agoC-Dash: Add "hosts" to rls2406 iterative data 29/41029/2
Tibor Frank [Mon, 3 Jun 2024 11:21:32 +0000 (11:21 +0000)]
C-Dash: Add "hosts" to rls2406 iterative data

Change-Id: I038639ad010935d6144c79acb25e0e357beb3e96
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofix(ipsec): Enable anti_replay for -ar- suites 30/41030/1
Vratko Polak [Mon, 3 Jun 2024 11:54:47 +0000 (13:54 +0200)]
fix(ipsec): Enable anti_replay for -ar- suites

The -ar- suites had everything edited,
except that one agrument that would actually enable anti-replay.

Fixes: b9dff484de0725bca3f65739519d952e3be55cbe

Change-Id: Ib2c590a9be5271348ee15d4e4ab1b7c663559477
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoUpdate VPP_STABLE_VER files 46/41046/2
Tibor Frank [Mon, 3 Jun 2024 04:45:27 +0000 (04:45 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ic7c09ffab66e7ccd604653ea26c35ceaffa65094
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agofeat(jobspec): Add new new ipsec with UDP encap 26/41026/3
Vratko Polak [Fri, 31 May 2024 13:43:27 +0000 (15:43 +0200)]
feat(jobspec): Add new new ipsec with UDP encap

+ Only for dpdk-plugin and primary NIC.
 + Prefer Intel, as that seems to have more stable performance.
+ Only one testcase per suite: 1518B 1c.
+ Add full set of 10k AES256GCM tests where not present already.
+ Remove multi-core ipsec AVF tests from 3n-icx to keep duration small.
 - Performance of those was limited by CSIT-1948 anyway.

Change-Id: I9166f15b44071dafe89ac8ca7982f659006027ba
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofeat(jobspec): Align weekly ndrpdr to daily mrr 25/41025/2
Vratko Polak [Fri, 31 May 2024 12:45:50 +0000 (14:45 +0200)]
feat(jobspec): Align weekly ndrpdr to daily mrr

+ This mainly uncomments a bucnh of 3n-alt xl710 ipsec tests.
+ Otherwise the difference was quite small.

Change-Id: I8b67fcce157f36ed79e9692a0581e1115b3f6886
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofeat(ipsec): Add suites for more algs 20/40820/10
Vratko Polak [Wed, 29 May 2024 13:20:02 +0000 (15:20 +0200)]
feat(ipsec): Add suites for more algs

+ Add suite with UDP encap.
+ Add suite with anti replay enabled.
+ Add new enums where needed by the new suites.
+ Apply trimming in enum_util to support "3DES".
+ All 10ktnl suites written and tested.
 + New robot tags added.
+ Fix one comment from the parent.

Change-Id: I2581814dbb327891d8658dd009c4e52ffd318e3b
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofeat(jobspecs): Add more soak tests 88/40988/2
Vratko Polak [Wed, 29 May 2024 12:58:13 +0000 (14:58 +0200)]
feat(jobspecs): Add more soak tests

+ Add l2xcbase.
+ Add 200k scale, both ip4 and ip6.
+ Test 200k and l2bdmaclearn also on:
 + Primary NIC with secondary driver.
 + Secondary NIC and its primary driver.
+ Add 1518B memif test cases, for 2n-spr also with DMA (including 64B).
 + This needed an edit in autogen.
+ Switch crypto tests to drv_vfio_pci as AVF has bad RSS on those.
+ Add two SRv6 cases to 3n-icx as it does not support hwasync crypto.
+ Repair name of UDP ASTF tests.

Change-Id: I91e20ec80dc4984c55d39b5f5ad38f26b48da33e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofeat(profiles): Do not share seeds between streams 95/40995/5
Vratko Polak [Fri, 31 May 2024 12:23:38 +0000 (14:23 +0200)]
feat(profiles): Do not share seeds between streams

Avoiding any predictable memory access patterns
is more important than similarity between 2p and 6p profiles.

+ Seed values now match parts of IP source address.

Change-Id: Ib1830cf9d3e7b329e54de19a92ecea77c8baeeb5
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofeat(hoststack): Enable L4 checksum RX offload 22/41022/3
Vratko Polak [Fri, 31 May 2024 10:21:22 +0000 (12:21 +0200)]
feat(hoststack): Enable L4 checksum RX offload

As hoststack is never tested in container/VM (yet),
configuration there does not check the new flag.

Change-Id: Icac4837efcf035cad0f1e126e1bf90811aba16b2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agostyle(jumbo): Unify naming of jumbo flag 20/41020/1
Vratko Polak [Fri, 31 May 2024 08:11:32 +0000 (10:11 +0200)]
style(jumbo): Unify naming of jumbo flag

Previously, the flag was sometimes called "jumbo",
sometimes "jumbo_frames". As we never use "jumbo" for things
other than frame size, unify the flag to "jumbo".

Change-Id: Ib688389799a4550ac9f51375f4defc06a02e6f03
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoRevert "feat(hoststack): Enable L4 checksum RX offload" 09/41009/1
Peter Mikus [Fri, 31 May 2024 04:13:43 +0000 (04:13 +0000)]
Revert "feat(hoststack): Enable L4 checksum RX offload"

This reverts commit 4e897a7a91e8b4782da05a4c906392e62c8f8ab5.

Reason for revert: Container/Qemu is not conditioned.

Change-Id: I497caa2db24803f40811b3c60c359b4772cacda7
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
10 months agofeat(hoststack): Enable L4 checksum RX offload 93/40993/2
Vratko Polak [Thu, 30 May 2024 08:51:57 +0000 (10:51 +0200)]
feat(hoststack): Enable L4 checksum RX offload

Change-Id: I169b06433ae962811aafa91ce90fe169b0bc4c71
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agoC-Docs: Add links to C-Dash apps 91/40991/1
Tibor Frank [Thu, 30 May 2024 06:52:32 +0000 (06:52 +0000)]
C-Docs: Add links to C-Dash apps

Change-Id: I1bb9b3af12737203d45f981b80be88290d2c7be4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
10 months agostyle(crypto): Move robot tag DRV_VFIO_PCI 89/40989/1
Vratko Polak [Wed, 29 May 2024 13:18:36 +0000 (15:18 +0200)]
style(crypto): Move robot tag DRV_VFIO_PCI

Move DRV_VFIO_PCI after TXQ_SIZE_0.
Upcoming suites need more space in the preceding line.

131 suite files edited, luckily doable by two commands:
$ sed -i 's/ | DRV_VFIO_PCI//' *.robot
$ sed -i 's/ | TXQ_SIZE_0/ | TXQ_SIZE_0 | DRV_VFIO_PCI/' *.robot

Change-Id: Idf30d20d321922718d523a216056d22ae67e50aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
10 months agofix(core): AWS interface initialization 86/40986/2
pmikus [Wed, 29 May 2024 11:54:11 +0000 (11:54 +0000)]
fix(core): AWS interface initialization

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I3ef110e8fec2fa8abafead1392a1b2af5e59f803

10 months agofix(packer): Update AWS image 23/40923/5
pmikus [Thu, 23 May 2024 11:37:23 +0000 (13:37 +0200)]
fix(packer): Update AWS image

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I1907fcb88dff0bb62cc6f5a8bf3ea58e3ad1578d

10 months agofeat(terraform): New AWS AMI image 85/40985/1
pmikus [Wed, 29 May 2024 10:27:43 +0000 (12:27 +0200)]
feat(terraform): New AWS AMI image

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I6951c4fc9f96a0acf44ba3201c91c9cb903889d7

10 months agofix(hoststack): Do not limit number of RX queues 77/40977/2
Vratko Polak [Tue, 28 May 2024 13:50:02 +0000 (15:50 +0200)]
fix(hoststack): Do not limit number of RX queues

This makes most scale hoststack tests correctly use both sibling cores.

- Except quic multi-client ones, which start failing instead.
 - To be fixed later.
 - VPP startup.conf looks correct to me.
 - All quic tests suffer from CSIT-1935 so no big loss.

Change-Id: If22c01651140865e188733039890f1fb0ceaa57a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agofeat(hoststack): Add stat pre/post actions 24/40924/6
Vratko Polak [Tue, 28 May 2024 08:18:08 +0000 (10:18 +0200)]
feat(hoststack): Add stat pre/post actions

While adding runtime actions to hoststack tests is not easy,
adding pre and post actions for stats is easy.
The main hoststack measurement is treated as the stats trial,
the same way as the 10 measurements in MRR tests are.

+ Remove the previous partial info via "show" CLI commands.
- As in other VPP tests, stat telemetry is not exported.

Change-Id: Ib567aa810418568520d4d543c6d50431e85a3269
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoC-Dash: Fix: Zero division error 34/40934/2
Tibor Frank [Tue, 28 May 2024 08:21:08 +0000 (08:21 +0000)]
C-Dash: Fix: Zero division error

Change-Id: Ie3a61153c3e286f196617be438c2056a001b6faa
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agofeat(etl): Add hosts 33/40933/1
pmikus [Tue, 28 May 2024 06:49:29 +0000 (08:49 +0200)]
feat(etl): Add hosts

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ibd3d0a1cdce67d17bfbe6fadfc1311af420a6c50

11 months agoRevert "feat(topology): Enable 2 QATs" 54/40954/2
Peter Mikus [Tue, 28 May 2024 06:40:20 +0000 (06:40 +0000)]
Revert "feat(topology): Enable 2 QATs"

This reverts commit 1776b3a1a483fd87170dfc0bf2eeb7eb610783bc.

Reason for revert: .

Change-Id: Ibad4684d16c4a348f27371cb2c4108f07cdaed21
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
11 months agoC-Docs: Update rls2406 notes. 31/40931/1
Tibor Frank [Mon, 27 May 2024 11:18:01 +0000 (11:18 +0000)]
C-Docs: Update rls2406 notes.

Change-Id: Iba15dc18b9e49dee0776e2897e45264a20ff2817
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoC-Dash: Add rls2406 data 13/40913/3
Tibor Frank [Wed, 22 May 2024 09:17:36 +0000 (09:17 +0000)]
C-Dash: Add rls2406 data

Change-Id: Id597a02e3d8586f4c712ebf9eaddc46315b2a844
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoUpdate VPP_STABLE_VER files 51/40951/2
Tibor Frank [Mon, 27 May 2024 06:26:36 +0000 (06:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: If6f1c306c6c5d72708e447825f17debedbaa4b4f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agofeat(topology): Enable 2 QATs 30/40830/2
pmikus [Fri, 26 Apr 2024 14:19:04 +0000 (14:19 +0000)]
feat(topology): Enable 2 QATs

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5cec80ece019f660bc449349ce78ec2f35c5bd22

11 months agofix(etl): Typo" 17/40917/1
pmikus [Wed, 22 May 2024 13:05:20 +0000 (13:05 +0000)]
fix(etl): Typo"

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ibd49015bc810a040d28509efc2e4bca26875229e

11 months agofeat(etl): Release pipelines 16/40916/2
pmikus [Wed, 22 May 2024 12:30:49 +0000 (14:30 +0200)]
feat(etl): Release pipelines

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4ce20267b4747bf1901b6175e0ec5936b583a510

11 months agoUpdate DPDK_STABLE_VER files 15/40815/2
Tibor Frank [Wed, 22 May 2024 11:13:35 +0000 (11:13 +0000)]
Update DPDK_STABLE_VER files

Change-Id: Ia4355295e783f29c87db6ed009370bd794d9b4ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoC-Doc: Add placeholder for 2406 rls notes. 15/40915/1
Tibor Frank [Wed, 22 May 2024 11:08:30 +0000 (11:08 +0000)]
C-Doc: Add placeholder for 2406 rls notes.

Change-Id: I89f2d314ff5ed33a86407489733544f197ad3d87
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoC-Dash: Enable reading of constants from env variables 00/40900/7
Tibor Frank [Mon, 20 May 2024 07:59:30 +0000 (07:59 +0000)]
C-Dash: Enable reading of constants from env variables

+ add switching on/off the apps

Change-Id: I46e0cd2f214fd6a05ec0b87a433708bc4b6e2eb1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agofix(various): files 08/40908/2
pmikus [Tue, 21 May 2024 13:28:21 +0000 (15:28 +0200)]
fix(various): files

Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I601a54e543114957592548618df2f2f4bf790f82

11 months agofix(hoststack): Use TX checksum offload 06/40906/1
Vratko Polak [Tue, 21 May 2024 10:49:42 +0000 (12:49 +0200)]
fix(hoststack): Use TX checksum offload

Some tests were already doing that via Set Test Variable,
this moves the flag into Variables table for every suite.

Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agofix(perf): Increase threshold for jumbo 01/40901/2
Vratko Polak [Mon, 20 May 2024 15:01:11 +0000 (17:01 +0200)]
fix(perf): Increase threshold for jumbo

The old limit of 1522 was introduced long time ago.
First, it appeared here [0], where it is correct
as that suite has zero overhead.
The first suite with wrong logic seems to be here [1]
(no "Add No Multi Seg to all DUTs" in 1518B testcase).
And when I was moving that logic to a keyword in [2],
I did not realize it is wrong with overhead.

This Change uses 1800 as the new threshold,
matching the value used for non-jumbo MTU.

[0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70
[1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229
[2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84

Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoUpdate VPP_STABLE_VER files 12/40812/2
Tibor Frank [Mon, 20 May 2024 06:17:36 +0000 (06:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I818cc10e971c85cd8e712c05536b5813bf18749a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agofeat(device): Reconfigure 95/40895/4
pmikus [Fri, 17 May 2024 06:13:36 +0000 (06:13 +0000)]
feat(device): Reconfigure

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654

11 months agofeat(bootstrap): Add more granular eb scripts 94/40894/2
pmikus [Thu, 16 May 2024 08:56:08 +0000 (10:56 +0200)]
feat(bootstrap): Add more granular eb scripts

Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536

11 months agofeat(CpuUtils): Allow suites to forbid siblings 86/40886/4
Vratko Polak [Tue, 14 May 2024 13:07:58 +0000 (15:07 +0200)]
feat(CpuUtils): Allow suites to forbid siblings

Some perf suites use a single unidirectional flow of traffic.
On SMT-enabled machines, 1C tests create 2 workers by default.
But if there is only one stream/flow,
only one worker does useful work.
The other worker on the sibling logical core
does busy-wait, which provably lowers the peformance.

Some suites already set smt_used (as a suite variable)
to False for these purposes.
This change edits a lower-level L1 keyword to honor this value,
and adds the suite variable to single stream (and client) hoststack
suites, where the detrimental effect of busy siblings was observed.

Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agofeat(hoststack): Apply no-muti-seg 85/40885/2
Vratko Polak [Mon, 13 May 2024 17:25:58 +0000 (19:25 +0200)]
feat(hoststack): Apply no-muti-seg

+ State frame size as 1518 octets, even if some packets are smaller.
 + This implicitly makes CSIT keywords to apply n-milti-seg.
- Real frame size is currently not important.

Change-Id: I754eac7e7ebf0378efb27149862004e35c387505
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
11 months agoUpdate VPP_STABLE_VER files 11/40811/2
Tibor Frank [Mon, 13 May 2024 05:15:35 +0000 (05:15 +0000)]
Update VPP_STABLE_VER files

Change-Id: I8ab964a6196dc3e81a4b7a9e7d8a7f0c0e2a0002
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoAdd 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5. 47/40847/4 oper-240513
Maciek Konstantynowicz [Tue, 30 Apr 2024 16:35:33 +0000 (17:35 +0100)]
Add 2048B file size  cps rps tests in job specs for http-ldpreload-nginx-1_21_5.

Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Change-Id: Id4b562259e6d86642152298bf500b353f1785939
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
11 months agoC-Dash: replace s3-logs by logs 71/40871/1
Tibor Frank [Mon, 6 May 2024 10:12:01 +0000 (10:12 +0000)]
C-Dash: replace s3-logs by logs

Change-Id: Ib702521379e3f93b6e223882e187827e84b1189c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoUpdate VPP_STABLE_VER files 09/40809/2
Tibor Frank [Mon, 6 May 2024 06:11:10 +0000 (06:11 +0000)]
Update VPP_STABLE_VER files

Change-Id: I09706e24780e34dc8f02e36acc25ec7066aea9cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
11 months agoRevert "fix(jobspec): Delete ipsec nfv density tests" 08/40808/2
Peter Mikus [Wed, 1 May 2024 05:04:03 +0000 (05:04 +0000)]
Revert "fix(jobspec): Delete ipsec nfv density tests"

This reverts commit 573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4.

Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
11 months agoRevert "feat(profiles): Do not repeat seeds in 6p profiles" 07/40807/2
Peter Mikus [Wed, 1 May 2024 04:55:46 +0000 (04:55 +0000)]
Revert "feat(profiles): Do not repeat seeds in 6p profiles"

This reverts commit b8f31fc3da4b0a6ab5805eea61af0fe7e869a453.

Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>