pmikus [Wed, 22 May 2024 13:05:20 +0000 (13:05 +0000)]
fix(etl): Typo"
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ibd49015bc810a040d28509efc2e4bca26875229e
pmikus [Wed, 22 May 2024 12:30:49 +0000 (14:30 +0200)]
feat(etl): Release pipelines
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I4ce20267b4747bf1901b6175e0ec5936b583a510
Tibor Frank [Wed, 22 May 2024 11:13:35 +0000 (11:13 +0000)]
Update DPDK_STABLE_VER files
Change-Id: Ia4355295e783f29c87db6ed009370bd794d9b4ce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 22 May 2024 11:08:30 +0000 (11:08 +0000)]
C-Doc: Add placeholder for 2406 rls notes.
Change-Id: I89f2d314ff5ed33a86407489733544f197ad3d87
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 20 May 2024 07:59:30 +0000 (07:59 +0000)]
C-Dash: Enable reading of constants from env variables
+ add switching on/off the apps
Change-Id: I46e0cd2f214fd6a05ec0b87a433708bc4b6e2eb1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Tue, 21 May 2024 13:28:21 +0000 (15:28 +0200)]
fix(various): files
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I601a54e543114957592548618df2f2f4bf790f82
Vratko Polak [Tue, 21 May 2024 10:49:42 +0000 (12:49 +0200)]
fix(hoststack): Use TX checksum offload
Some tests were already doing that via Set Test Variable,
this moves the flag into Variables table for every suite.
Change-Id: I54e86f3fd10354dc87c2f04c70bbab771f89f3d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 20 May 2024 15:01:11 +0000 (17:01 +0200)]
fix(perf): Increase threshold for jumbo
The old limit of 1522 was introduced long time ago.
First, it appeared here [0], where it is correct
as that suite has zero overhead.
The first suite with wrong logic seems to be here [1]
(no "Add No Multi Seg to all DUTs" in 1518B testcase).
And when I was moving that logic to a keyword in [2],
I did not realize it is wrong with overhead.
This Change uses 1800 as the new threshold,
matching the value used for non-jumbo MTU.
[0] https://gerrit.fd.io/r/c/csit/+/2652/12/tests/perf/Bridge_Domain_Intel-X520-DA2.robot#70
[1] https://gerrit.fd.io/r/c/csit/+/4454/96/tests/perf/40ge2p1xl710-ethip4ipsecscaleip4-ip4base-interfaces-aes-gcm-ndrpdrdisc.robot#229
[2] https://gerrit.fd.io/r/c/csit/+/13411/35/resources/libraries/robot/performance/performance_utils.robot#84
Change-Id: Iff3703fcff0e4bbb1a6b10be359fa5ef67fd5422
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 20 May 2024 06:17:36 +0000 (06:17 +0000)]
Update VPP_STABLE_VER files
Change-Id: I818cc10e971c85cd8e712c05536b5813bf18749a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Fri, 17 May 2024 06:13:36 +0000 (06:13 +0000)]
feat(device): Reconfigure
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I5ca0fc5832c249553c79dd9c5d4148ba64e61654
pmikus [Thu, 16 May 2024 08:56:08 +0000 (10:56 +0200)]
feat(bootstrap): Add more granular eb scripts
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Icbcd373ef815fa082d9be022fc201c96df140536
Vratko Polak [Tue, 14 May 2024 13:07:58 +0000 (15:07 +0200)]
feat(CpuUtils): Allow suites to forbid siblings
Some perf suites use a single unidirectional flow of traffic.
On SMT-enabled machines, 1C tests create 2 workers by default.
But if there is only one stream/flow,
only one worker does useful work.
The other worker on the sibling logical core
does busy-wait, which provably lowers the peformance.
Some suites already set smt_used (as a suite variable)
to False for these purposes.
This change edits a lower-level L1 keyword to honor this value,
and adds the suite variable to single stream (and client) hoststack
suites, where the detrimental effect of busy siblings was observed.
Change-Id: I203f1a700d8e6cd84640b9c0b40487cb832908aa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 13 May 2024 17:25:58 +0000 (19:25 +0200)]
feat(hoststack): Apply no-muti-seg
+ State frame size as 1518 octets, even if some packets are smaller.
+ This implicitly makes CSIT keywords to apply n-milti-seg.
- Real frame size is currently not important.
Change-Id: I754eac7e7ebf0378efb27149862004e35c387505
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 13 May 2024 05:15:35 +0000 (05:15 +0000)]
Update VPP_STABLE_VER files
Change-Id: I8ab964a6196dc3e81a4b7a9e7d8a7f0c0e2a0002
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Maciek Konstantynowicz [Tue, 30 Apr 2024 16:35:33 +0000 (17:35 +0100)]
Add 2048B file size cps rps tests in job specs for http-ldpreload-nginx-1_21_5.
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Change-Id: Id4b562259e6d86642152298bf500b353f1785939
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
Tibor Frank [Mon, 6 May 2024 10:12:01 +0000 (10:12 +0000)]
C-Dash: replace s3-logs by logs
Change-Id: Ib702521379e3f93b6e223882e187827e84b1189c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 6 May 2024 06:11:10 +0000 (06:11 +0000)]
Update VPP_STABLE_VER files
Change-Id: I09706e24780e34dc8f02e36acc25ec7066aea9cd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Wed, 1 May 2024 05:04:03 +0000 (05:04 +0000)]
Revert "fix(jobspec): Delete ipsec nfv density tests"
This reverts commit
573d59a0e3cafe60522e51dc9e5ba776c0a0a6e4.
Change-Id: I6fef1876d6f7274310243aa743f68b7e51daf486
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Peter Mikus [Wed, 1 May 2024 04:55:46 +0000 (04:55 +0000)]
Revert "feat(profiles): Do not repeat seeds in 6p profiles"
This reverts commit
b8f31fc3da4b0a6ab5805eea61af0fe7e869a453.
Change-Id: I65f79bb323f48d9e7b3ed7a1990db1b1486da26e
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Peter Mikus [Wed, 1 May 2024 04:54:27 +0000 (04:54 +0000)]
Revert "style(scale): Apply black to new traffic profiles"
This reverts commit
4e2635deff33db4bea476003ac222ffd9ab504b1.
Change-Id: Idb9145fbf13e7943392a72f77ef9a1b479187732
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Vratko Polak [Fri, 26 Apr 2024 11:58:43 +0000 (13:58 +0200)]
feat(ipsec): Use strings instead of enums in Robot
Only related to enums appearing in ipsec suites.
+ Add conversion utility as enum_utils.py file.
+ Rename PolicyAction closer to ipsec_types.api: IpsecSpdAction.
+ Device and perf suites updated to use str in Variables table.
- Perf suites are being tested.
Change-Id: I3b1678c4d6cc303c590e5e3665ab1b05d104a121
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Kai Ji [Wed, 24 Apr 2024 16:18:42 +0000 (16:18 +0000)]
fix(hoststack): Remove unwanted api trace in DMA test
Change-Id: I48ec272fb150c09221142b8d73830d7b6741d0b5
Signed-off-by: Kai Ji <kai.ji@intel.com>
Vratko Polak [Tue, 30 Apr 2024 12:55:15 +0000 (14:55 +0200)]
style(scale): Apply black to new traffic profiles
+ Add trailing commas to prevent black from collapsing argument lists.
Change-Id: I8a2f2aca0df7a9271a073f87603f9abfa4870b11
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 30 Apr 2024 12:54:57 +0000 (14:54 +0200)]
feat(profiles): Do not repeat seeds in 6p profiles
On one hand, using seed==1 for all W-E streams
and seed=2 for all E-W streams would make 6p tests
even more comparable with 2p tests.
But current rnd profiles were mixing the two seed values.
On the other hand, using unique seed values for each stream
would ensure VPP is less likely to deviate from average preformance.
As the second approach also results in smaller profile files,
this patch applies that approach.
Change-Id: If0f57282a2899a1a4fb154dd6ed810064cb5c212
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 30 Apr 2024 12:54:36 +0000 (14:54 +0200)]
fix(profiles): Properly randomize in last profile
The file trex-stl-ethip6-ip6dst-rnd1000000-6p.py
was not properly edited when converting from a non-random profile.
Change-Id: I2fdf424176c69467dcf00cd4dc15f147c3576817
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 30 Apr 2024 12:54:15 +0000 (14:54 +0200)]
cleanup(ip4scale): Delete recently orphaned rnd profiles
The rnd suites were already migrated to use the -2p profiles instead.
The non-rnd traffic profiles (without -2p) are still used
in trex suites and some ipsec suites, so they cannot be removed yet.
Change-Id: Ibc97b039c218418701081d3838ef40987110ef64
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 29 Apr 2024 04:30:39 +0000 (04:30 +0000)]
Update VPP_STABLE_VER files
Change-Id: I927f8aa6797fd6f081bc2f618b1b7e379aaa3e12
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 29 Apr 2024 05:12:22 +0000 (05:12 +0000)]
job-spec: fix dma
Change-Id: I6202314a26fcba8cebc42eeebc3708732116caeb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 29 Apr 2024 04:51:34 +0000 (04:51 +0000)]
job-spec: Add eth-ip4tcphttp-dma-ldpreload-nginx-1_21_5
- 2n-icx and
- 2n-spr
Change-Id: I6c1ebcd38081b86209a27fdf224923b236179ee4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Fri, 26 Apr 2024 13:39:12 +0000 (15:39 +0200)]
Revert "fix(IPsecUtil): Delete keywords no longer used"
This reverts commit
79635f7cdfb7046230473570068f97a159cf87b4.
Peter says he is using those.
Change-Id: I47886ba0676bc74d5189a2986ac347f49fdde36c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 26 Apr 2024 12:44:46 +0000 (14:44 +0200)]
fix(IPsecUtil): Delete keywords no longer used
When deleting ipsec nvf density suites,
I removed the main L2 Robot keyword,
but forgot to remove the associated L1 Python keywords.
Change-Id: I0f72699dcab272aec5c531cdaacceed30356cd02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 26 Apr 2024 12:33:33 +0000 (14:33 +0200)]
fix(jobspec): Delete ipsec nfv density tests
We already deleted the job and the suites.
Change-Id: I0d9c4da14651884d6eeb3e200277b0ef5823df60
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Fri, 26 Apr 2024 11:26:38 +0000 (11:26 +0000)]
feat(tests): IPsecHW rxq ratio
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I17866709e1c7edf078055aef4db15774e136b111
pmikus [Fri, 26 Apr 2024 06:05:44 +0000 (06:05 +0000)]
feat(profiles): IPv6 unseed
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I72a91c6270bd43fd41b8d7389b759305d9a3d408
Vratko Polak [Thu, 25 Apr 2024 13:56:54 +0000 (15:56 +0200)]
feat(density): Delete ipsec nfv_density tests
They are broken for more than two years
and they relied on CLIs that changed in VPP anyway.
Ticket: CSIT-1856
Change-Id: I0f278ff61a9da5e6040e08bf3e92049cb33c8a93
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 25 Apr 2024 11:39:05 +0000 (13:39 +0200)]
fix(methodology): Update info for soak and ndrpdr
Change-Id: I58fa4b3494c6148735a992f2c0e8a7ba771660a8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Thu, 25 Apr 2024 11:20:10 +0000 (11:20 +0000)]
job-spec: Add more ipsec hw tests to 3n-snr and 3n-icxd
Change-Id: I1e874ad107dd961e886e544f7d7017086523f894
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 23 Apr 2024 12:04:13 +0000 (12:04 +0000)]
C-Dash: Add soak tests
Change-Id: Ibe17b7dc2125fa6ace496897a7cf9115a5f2c736
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 25 Apr 2024 05:51:25 +0000 (05:51 +0000)]
job-spec: Add ipsec hw tests to 3n-snr and 3n-icxd
Change-Id: I46a6cf74da419e85b5b22a93a5703709a677a8ad
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Thu, 25 Apr 2024 05:49:13 +0000 (05:49 +0000)]
feat(profiles): Cleanup IPv6 profiles
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib9d1d819e59be768377f3a61578c22699a10f0a8
Peter Mikus [Thu, 25 Apr 2024 05:00:58 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"
This reverts commit
b06f091ae65a7323231d84d188b863698169508b.
Reason for revert: .
Change-Id: I4c36a8ca1dd28db853e9eefef9a409142d073779
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Peter Mikus [Thu, 25 Apr 2024 05:00:10 +0000 (05:00 +0000)]
Revert "fix(ip6scale): Unify rnd profiles"
This reverts commit
b06f091ae65a7323231d84d188b863698169508b.
Reason for revert: .
Change-Id: I99b7c3365e7e74aadcf366c8ca284ad458dcc8e6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Vratko Polak [Wed, 24 Apr 2024 11:11:27 +0000 (13:11 +0200)]
fix(ip6scale): Unify rnd profiles
Some were not even using STLVmFlowVarRepeatableRandom.
+ Simplify seed calculation.
Change-Id: If3211dd2336838ee1ad7137563ddf8cc90ebea00
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Mon, 22 Apr 2024 15:59:42 +0000 (17:59 +0200)]
style(ipsec): add type hints to IPsecUtil
+ Update docstrings to match.
Change-Id: I20f8f0247a9cf38a2d9a98fa8905eb55d91817f7
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Tue, 23 Apr 2024 12:31:32 +0000 (14:31 +0200)]
feat(etl): SOAK
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ic8cd4cc6de271ca39b2b9d4e07da2718772e9a38
Vratko Polak [Mon, 22 Apr 2024 14:24:54 +0000 (16:24 +0200)]
style(ipsec): Unify mutiline strings
+ One more pylint improvement not worth a separate change.
Change-Id: I5a2a3a4c70909fefd3fdf6f3ed8b344d19fc823e
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Fri, 19 Apr 2024 08:50:21 +0000 (10:50 +0200)]
style(ipsec): Fix some issues reported by pylint
+ Fix typo "enale".
- Many style and complexity issues remain:
C0302, R0904, R0914, R0913, R1735, R0915, R1734.
Change-Id: I7e8c7ecefd8f8f94dcbc28427baa52a9c8ea1227
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
xinfengx [Thu, 19 Oct 2023 01:02:48 +0000 (01:02 +0000)]
Add hoststack with DMA test suites
Change-Id: Idef14bef816a04ca43ab9aced4b1441ef818e066
Signed-off-by: xinfengx <xinfengx.zhao@intel.com>
Vratko Polak [Mon, 22 Apr 2024 08:52:32 +0000 (10:52 +0200)]
fix(ip6scale): Document correct prefix length
We are testing /128 in ip6 scale tests for a long time,
but we did not update the suite documentation when we switched.
This does that.
Note that ip6 bas (and feature) tests are still using /64.
Change-Id: I5e108497b3f516195fce0e480ca3ec18d204bd84
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 22 Apr 2024 04:04:28 +0000 (04:04 +0000)]
Update VPP_STABLE_VER files
Change-Id: If4175b67b34c96a097cbc7f250535159eef816be
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 18 Apr 2024 12:45:29 +0000 (14:45 +0200)]
feat(jobspec): Unify soak jobspecs
Added 9 common tests (only one for non-default NIC+driver),
4 specific to nodeness (ASTF for 2-node, IPsec for 3-node).
+ First round, we can add more tests when duration is stable.
- Left TODOs for possible improvements.
Change-Id: I4724e3a05af0dfbf2ca0c146f1bbd4665d9e0cf0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Thu, 18 Apr 2024 10:37:09 +0000 (10:37 +0000)]
feat(tests): IPv6 fixes
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I9bc9f9fe410c0fa78e20a234487e63eb42f3fe3f
pmikus [Wed, 17 Apr 2024 13:22:13 +0000 (13:22 +0000)]
feat(job_specs): Add soak test
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I48240d2df2ee7908d07da86a4e4da359178d0b9e
Peter Mikus [Thu, 18 Apr 2024 06:57:25 +0000 (06:57 +0000)]
Revert "fix(ip6): Use updated profile names in 2n suites"
This reverts commit
b3c5215bba37bd6555231da8c40ae90d9fc570c9.
Reason for revert: Makes no sense
Change-Id: Iabe098114a0e98a89e815daf706745917d8504a6
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Vratko Polak [Wed, 17 Apr 2024 08:52:33 +0000 (10:52 +0200)]
fix(ipsec): Prepare IPsecUtil for upcoming changes
+ Separate sad into two cycles.
+ Do not update flags in each iteration.
+ Update inner dicts.
Change-Id: Ic81dfc6e614cc78ff321fba748d48a30678cc88a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 17 Apr 2024 15:26:56 +0000 (17:26 +0200)]
style(ipsec): Do not import ipsec.robot to suites
It is already available via default.robot import.
Change-Id: I52c8f5d62f641edfbbc4b750e40274a75b169a22
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 17 Apr 2024 15:24:24 +0000 (17:24 +0200)]
feat(tox): add copyright year fixer script
It uses rather simple sed commands, but seems to work well enough.
+ Improve readme.
+ Shortened comments about why 3 lines.
Change-Id: I50b395dfeb586f671f7c4c82f22369de90b351ec
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 17 Apr 2024 12:49:59 +0000 (14:49 +0200)]
fix(ip6): Use updated profile names in 2n suites
Change-Id: If5cc42bac1c49d1f1d960e0812ab352564bc29d2
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 16 Apr 2024 11:58:58 +0000 (13:58 +0200)]
style(IPsecUtil): Apply black formatting
Change-Id: I7cc2bc69c6849360abff0bd18b2ae3b93e2303c4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Thu, 11 Apr 2024 16:24:03 +0000 (18:24 +0200)]
feat(api): Use newest API messages after rls2402
+ gtpu_add_del_tunnel_v2
+ Add comments on used values and unused fields.
+ ipsec_sad_entry_add_v2
+ Explicitly pass current default values.
+ ipsec_sa_v5_dump
+ policer_add
+ The old is_add argument removed, it was never false.
+ sr_policy_add_v2
+ Add comments about currently unused fields.
+ Support also older VP builds with wrong reply.
+ rdma_create_v4
+ Add comments about unused fields.
Change-Id: I3d5bc345c4cf099661626770c4d86bc230643cca
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 15 Apr 2024 04:48:50 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files
Change-Id: If792605aebeeedc722bc677b693be75858ac61e0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 20 Dec 2023 13:28:36 +0000 (13:28 +0000)]
feat(tests): IPv6 scale
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I720b7c96a6ac9f328aff57437e51254364604911
Vratko Polak [Wed, 10 Apr 2024 13:22:53 +0000 (15:22 +0200)]
feat(job-spec): Unify memif 1518B tests for 2n-spr
+ Add 4c 1518B tests to all memif 2n-spr coverage suites.
+ Add 1518B cases to iterative, so recently added DMA can be compared.
Change-Id: I589fd7efe30bb70e0255bb5c94fa23c2782a7860
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 10 Apr 2024 10:34:02 +0000 (12:34 +0200)]
fix(report): Update RCA
Probably last update this cycle.
Few remamining failures were seen,
but they are probably too rare to reproduce.
Change-Id: Ia0e1dd20ed23412584624dc313c9de09d2081429
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 9 Apr 2024 08:22:49 +0000 (10:22 +0200)]
fix(perpatch): Sort comparison output by test name
Change-Id: Id68a4e2b7514b9cf2e1f2f30b78dc0cd696a673a
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Mon, 8 Apr 2024 04:06:10 +0000 (04:06 +0000)]
Update VPP_STABLE_VER files
Change-Id: I9e7cd93d7b07ba86e11eb9b75a9a11a6f3b4c617
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 4 Apr 2024 11:01:47 +0000 (13:01 +0200)]
Fix(perpatch): improve compare script output
+ Make tests more searchable by "Test name" prefix.
+ Shorten the output code (fewer duplication and continues).
Change-Id: I0adfac146a689466345a30646e41fe948ea264ae
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 3 Apr 2024 14:24:17 +0000 (14:24 +0000)]
job-spec: Add memif DMA 1518B tests
Change-Id: I82ccfc639f7652d9a2ac248200ed2d49f93947dc
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Peter Mikus [Tue, 2 Apr 2024 06:56:08 +0000 (06:56 +0000)]
Revert "fix(topologies): Disable tb31 so jobs use tb32"
This reverts commit
2734517899b6c109da520e6aef0866c8b78ec708.
Reason for revert: not a proper solution, just hides an issue
Change-Id: I51cb6875748c29e5bae5894c0cbabf1caf231817
Signed-off-by: Peter Mikus <pmikus@cisco.com>
Tibor Frank [Tue, 2 Apr 2024 04:17:46 +0000 (04:17 +0000)]
Update VPP_STABLE_VER files
Change-Id: I31939169c1dee80d496fa9d5bcfa3ef3b071eb1a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Wed, 27 Mar 2024 14:15:20 +0000 (15:15 +0100)]
fix(topologies): Disable tb31 so jobs use tb32
As tb31 is the first reserved for 3n-icxd jobs,
most runs are currently failing due to CSIT-1951
(TwentyFiveGigabitEthernet89/0/2 does not do up).
Change-Id: I045e10daf114e02d3b46fc0e5a0cf9d080605092
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 27 Mar 2024 12:39:51 +0000 (13:39 +0100)]
fix(report): Update RCA for this week
Change-Id: I4c3dfc60361d1109c92f64b4fe360f7063cdf9b9
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Wed, 13 Mar 2024 13:00:46 +0000 (14:00 +0100)]
fix(perpatch): Do not repeat test name
When searching for a specific test,
it is confusing to see the name twice,
first time close to previous test classification.
Change-Id: I43d838090f89d23af9da1dc93f9dd1946aebae75
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
pmikus [Mon, 25 Mar 2024 13:49:25 +0000 (14:49 +0100)]
fix(terraform): vpp-device files
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I7f640aa28ecf3a60696676b0cf8afb7a080e1b12
Tibor Frank [Mon, 25 Mar 2024 12:49:48 +0000 (12:49 +0000)]
Update VPP_STABLE_VER files
Change-Id: I32b3ae5beeeb42a6d4ccbe38d92b95c7803c2e01
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Mon, 18 Mar 2024 14:43:12 +0000 (15:43 +0100)]
Revert "fix(core): Disable core dbg analysis"
This reverts commit
ffca8b8655c772fc6273702cae2151e7ac7a846d.
+ Add 10 second sleep, could help if core is big.
Change-Id: Id2b3199737f8c50cee713e8626dce1bfa72ea4e1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 20 Mar 2024 05:43:03 +0000 (05:43 +0000)]
C-Dash: Add detailed views to comparison tables
Change-Id: I0936f736497299f8b9fc1254012b2a0b20c41bfb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Thu, 21 Mar 2024 09:03:01 +0000 (10:03 +0100)]
feat(tests): Remove unsupported suites
The new suites were added in [1]
and the VPP functionality was removed in [2].
[1] https://gerrit.fd.io/r/c/csit/+/28508
[2] https://gerrit.fd.io/r/c/vpp/+/31443
Change-Id: Id3fa984bf9f61a1dd831d637695ac6844c86ffc8
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Vratko Polak [Tue, 19 Mar 2024 15:56:42 +0000 (16:56 +0100)]
fix(report): Two more issues found so far
Change-Id: Ie3b8bf1a0068f0c085806526c97d964b8488b777
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Wed, 20 Mar 2024 06:25:35 +0000 (06:25 +0000)]
job-spec: Add DMA tests
Change-Id: I6530519eaab2d09a187dddd803815888606ff17d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 18 Mar 2024 05:33:05 +0000 (05:33 +0000)]
Update VPP_STABLE_VER files
Change-Id: If6157519e738f47b2d284bb02592bb25380cc17a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
pmikus [Wed, 13 Mar 2024 14:24:47 +0000 (14:24 +0000)]
feat(tests): Fix scaling of 6p3nic
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: I84d9cf2892423e62b116b07982d3e87120b66271
Vratko Polak [Wed, 13 Mar 2024 12:18:17 +0000 (13:18 +0100)]
feat(report): Add currently known issues
Analysis is not finished yet, some updates may arrive next week.
Change-Id: I7a51e279fbb2807ee4064affda8ad445bbd01b02
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Tibor Frank [Tue, 12 Mar 2024 09:03:05 +0000 (09:03 +0000)]
C-Dash: Add tooltips
Change-Id: I00cf78e2e777fa96754f7b06aab02a8bf8682da5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 11 Mar 2024 12:00:34 +0000 (12:00 +0000)]
C-Dash: add "download row data" feature to comparison tables
Change-Id: Iaf5a57402e954453c237fb1e082da6c620cff59f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 11 Mar 2024 07:44:40 +0000 (07:44 +0000)]
C-Docs: Add a procedure to "Search tests".
Change-Id: I2b00894c6690cc1ae69d202f90fd9624c271832b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 11 Mar 2024 05:58:58 +0000 (05:58 +0000)]
Update VPP_STABLE_VER files
Change-Id: I70dcb89767587e225bf2585349211953e6ac8713
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Thu, 7 Mar 2024 12:00:04 +0000 (12:00 +0000)]
C-Dash: Add possiblity to remove outliers from comparison data
- extreme outliers only for now
Change-Id: I2be7c291dd207d5a557947415a960fa6d0067c64
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 4 Mar 2024 12:01:21 +0000 (12:01 +0000)]
C-Docs: Update release information
Change-Id: I77dbc422f502d0c342177598d30b3bcca7ea5e06
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Vratko Polak [Tue, 5 Mar 2024 12:25:39 +0000 (13:25 +0100)]
feat(ietf): MLRsearch draft-06
Change-Id: Ia9e22ba1eca74a32ae7141b1bd111bdb9baaddf3
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Juraj Linkeš [Mon, 12 Feb 2024 10:25:41 +0000 (11:25 +0100)]
feat(device): cx6 update of 1n-alt device jobspec
Update the jobspec according to the current Arm policy:
1. Run most of the tests on cx6, crypto coverage being the most
important,
2. Match the cx6 ipv4 crypto coverage with x710 with the DPDK driver,
3. Run basic ipv4 and l2 tests with x710 with borh DPDK and native (avf)
drivers.
The above is the policy used in performance testing where time is a
major constraint. The same is true for functional testing to some
extent, so it makes sense to apply the same logic for choosing the tests.
There are 10 tests which are failing on cx6 without an identified
reason. They are disabled until we find the root cause and address it.
In the meantime, the tests are enabled for x710 with the DPDK driver:
ethip4-l2xcbase-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2memif-1dcr
ethip4-l2bdbasemaclrn-eth-2tap
ethip4-l2bdbasemaclrn
ethip4-l2bdbasemaclrn-iacl1sf
ethip4-l2bdbasemaclrn-iacl1sl
ethip4-l2bdbasemaclrn-oacl1sf
ethip4-l2bdbasemaclrn-oacl1sl
ethip4-l2patch
ethip4-l2xcbase
When the cx6 issue has been resolved, these should be enabled for cx6
and disabled for x710, with the exception of ethip4-l2bdbasemaclrn,
which should be running on both.
Change-Id: Id48f450063e405b1faca57431676f91d62e829b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Tibor Frank [Mon, 4 Mar 2024 06:59:44 +0000 (06:59 +0000)]
Update VPP_STABLE_VER files
Change-Id: Ib84e4f147583c25c3fccff27a493dc07b37f7d9d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Tue, 20 Feb 2024 11:04:48 +0000 (11:04 +0000)]
C-Dash: Add search in tests
Change-Id: Ia250c4b4e299d48bc68cf01e65fe37a281047060
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Wed, 28 Feb 2024 05:58:03 +0000 (05:58 +0000)]
job-spec: add more ip4scale tests to 2n-spr and 3na-spr
Change-Id: I9c9a6ecd6698cb58e7114543de54eb01549d4af0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 26 Feb 2024 05:55:38 +0000 (05:55 +0000)]
Update VPP_STABLE_VER files
Change-Id: I9d6047a698c485e664f67bb4ea8847f683d0f688
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Tibor Frank [Mon, 19 Feb 2024 06:07:48 +0000 (06:07 +0000)]
Update VPP_STABLE_VER files
Change-Id: I84c7886a6181d24460665cd82ced2f83ced6f415
Signed-off-by: Tibor Frank <tifrank@cisco.com>
Juraj Linkeš [Fri, 16 Feb 2024 11:02:45 +0000 (12:02 +0100)]
feat(device): 1n-alt ansible improvement
We're seeing extra IGMP traffic which interferes with tests which must
be disabled. This is done by disabling the setting by default on all
interfaces.
The default setting is also adopted for other traffic-related
configuration:
Default sets the configuration when the interface is created. For
hardware interfaces, that is at boot time. For VF interfaces, when we
create them with the csit-initialize-vfs.sh script and for virtual
interfaces when they're created.
On the other hand, the all configuration option doesn't set the
configuration. It uses the current configuration value along with the
passed configuration value to produce a new value, which could be
expressed as:
f(old_value, value_from_all) -> new_value
Where f is a function specific to each configuration option. Using all
thus requires us to know the function and the old value which is less
reliable than just using default everywhere.
Also fix the 1n-alt VF init script.
Change-Id: I3da15abfb5a1e76769076edd95d20e2168b6f71f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
Juraj Linkeš [Thu, 8 Feb 2024 12:10:30 +0000 (13:10 +0100)]
feat(device): add cx6 to 1n-alt ansible
Also update 1n-alt hardware with info from dmidecode and port names to
match the rules in Testbed Naming Convention.
Change-Id: Ib654adaec5667f0e79a3cb86edfbf4578f5c3d5f
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
pmikus [Thu, 15 Feb 2024 10:22:27 +0000 (10:22 +0000)]
fix(core): daily jobs should not do prefixing
Signed-off-by: pmikus <peter.mikus@protonmail.ch>
Change-Id: I131cc9957b288f4e02e9d02394a1681dbb539d83
pmikus [Thu, 15 Feb 2024 09:22:38 +0000 (10:22 +0100)]
fix(bootstrap): typo
Signed-off-by: Peter Mikus <peter.mikus@protonmail.ch>
Change-Id: Ib2a1ceb9145ef5495c76954ac70cedc5af6fa297