csit.git
19 months agofix(jobspec): remove avf tests from 1n-tx 80/36980/1 rls2206
Juraj Linkeš [Fri, 19 Aug 2022 08:30:02 +0000 (10:30 +0200)]
fix(jobspec): remove avf tests from 1n-tx

1n-tx2 needs new i40e and iavf drivers, otherwise VF creation gets
stuck. With these new drivers, VPP AVF interfaces cannot be created
becasue of VPP-1995.

Disable the tests until the appropriate fix is present in (a newer
version of) i40e drivers.

Change-Id: I3ac5d3d7a677a696477c2766291f371df4a7b903
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7aaa3235a6f62abfd5caef36ff51387e45111691)

20 months agoReport: Set NIC limmits according to constant.py 44/36744/1
Tibor Frank [Tue, 2 Aug 2022 11:19:29 +0000 (13:19 +0200)]
Report: Set NIC limmits according to constant.py

Change-Id: I5d8d1bff4a1244a8819a4eb5c9756ea6c6749345
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0e62f455edc7e546bffb395d5212ecbf0f6adcae)

20 months agoReport: Add 2n-tx2 LXC/DRC Container Memif graphs 42/36742/1
Tibor Frank [Mon, 1 Aug 2022 08:34:34 +0000 (10:34 +0200)]
Report: Add 2n-tx2 LXC/DRC Container Memif graphs

- Packet Throughput
- Speedup Multi-Core
- Packet Latency

Change-Id: Ia98a44a5fad8676832d8c5beb687e1fd68e30d41
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d448485d152d3273fe4ef4db28566d99e23efd30)

20 months agoReport: NAT44 udp tput graphs 40/36740/1
Tibor Frank [Wed, 27 Jul 2022 13:12:15 +0000 (15:12 +0200)]
Report: NAT44 udp tput graphs

Change-Id: Ia5108792ec32d8c2ff68bba953c77be536aba379
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cfd5a3c3401a60e8044535f01d46b3312b07f201)

20 months agoReport: NAT44 graphs 37/36737/1
Tibor Frank [Wed, 27 Jul 2022 05:01:00 +0000 (07:01 +0200)]
Report: NAT44 graphs

Change-Id: Ia0dc9483cd615398193cbc9be059b8ce29e53eb5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9b2e7742555b773b6755833e688265b858ce0f6f)

20 months agofix(report): update the text part of release notes 36/36736/1
Vratko Polak [Tue, 26 Jul 2022 10:03:13 +0000 (12:03 +0200)]
fix(report): update the text part of release notes

Change-Id: I7c5b95b3b547f4d9a9359b0c688d621c3709b6f1
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 7889544ddfba775bf07bcd331f022de4650e59dc)

20 months agoReport: Add NAT44 tests 95/36695/1
Tibor Frank [Tue, 26 Jul 2022 10:30:00 +0000 (12:30 +0200)]
Report: Add NAT44 tests

Change-Id: I757331b2c1fafe80f1e0e7cf10db5690912823f5
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 054fc471e2f25e4d09287ab058daf9c04717d7b7)

20 months agofeat(jobspec): improve tput selection 94/36694/1
Vratko Polak [Mon, 25 Jul 2022 11:45:56 +0000 (13:45 +0200)]
feat(jobspec): improve tput selection

+ Revert bad edit on 2n-dnv, add 1518b back.
+ Add 1c ip4base tput everywhere nat44ed tput is tested.
 + Both tcp and udp.
+ Use only 1c tests for ip4base tput.
+ Use the same selection in mrr as in mlr.
- 2n-tx2 and 2n-zn2 still have no ASTF tests.
- ASTF tests still only tested on xxv710, no 100ge tests yet.

Change-Id: I0bfc1fa372c5020f1a6f2f4564c4b44f578ac328
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit fb12eb346edf4da6b263ac436c8ed6c801d30e19)

20 months agofix(jobspec): switch tcp tput back to 100b 91/36691/2
Vratko Polak [Tue, 19 Jul 2022 10:43:08 +0000 (12:43 +0200)]
fix(jobspec): switch tcp tput back to 100b

Change-Id: Id16649044ac0385d55766197fb921c38009c0da8
Ticket: CSIT-1830
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 739e01de7a65045dc42e6c16406a6d054da72f7b)

20 months agofix(astf): avoid issues in pps tput 89/36689/1
Vratko Polak [Wed, 20 Jul 2022 08:18:29 +0000 (10:18 +0200)]
fix(astf): avoid issues in pps tput

When more than 1 data packet is sent in the same chunk,
TRex is sometimes not fully deterministic
in its usage of delayed ACKs.

This changes the "application protocol" to sent
5 chunks (1 data packet each), c2s and s2c interleaved,
so each subsequent chunk acts as an ACK.

The overall packet count remains the same,
and even though this interleaved way may be more demanding
on TRex CPU, preliminary results show NAT performance
is still well below ip4base performance.

As a side effect, the interleaved way seems to work
also for 100B data frames, so we are avoiding two issues at once.

Ticket: CSIT-1846
Ticket: CSIT-1830

Change-Id: Ia4dcfa7c89f2c08fc32bd6118e2e009316b33c25
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b06a1adb1c26eeb5bf5c86091fef30441f6d06a1)

20 months agoReport: Set the week 84/36684/1
Tibor Frank [Mon, 18 Jul 2022 11:54:26 +0000 (13:54 +0200)]
Report: Set the week

Change-Id: Iaa8d112f044f1af9dd9d1e5e33a27baabbc8f20d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6357d15b639bc472c11a74bd2d3ec6e889ff1578)

20 months agoReport: Add rls data 82/36682/1
Tibor Frank [Mon, 18 Jul 2022 05:31:04 +0000 (07:31 +0200)]
Report: Add rls data

Change-Id: I35bd95c4a6259c9b8d80c9d7dc3261e7c1da837c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7ee22d108d867ef318c77f98afd0cb059732ec58)

20 months agofeat(report): add two more RCA items 81/36681/1
Vratko Polak [Fri, 15 Jul 2022 11:48:02 +0000 (13:48 +0200)]
feat(report): add two more RCA items

Change-Id: I14cb6411351ac38f976e4bfc18e13b50728c0f59
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 1b2710767a34113c266c81a18b98d71e0c8dd6ef)

21 months agofeat(report): add RCA items to release notes 80/36680/1
Vratko Polak [Wed, 13 Jul 2022 12:54:51 +0000 (14:54 +0200)]
feat(report): add RCA items to release notes

Change-Id: I6ba7ef6ddb61871d62a65fbad21da8d53bd1a073
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 6513c1b1663ae60f6870a2989a2d8e794b53a67e)

21 months agoReport: Add release data 79/36679/1
Tibor Frank [Thu, 14 Jul 2022 07:06:47 +0000 (09:06 +0200)]
Report: Add release data

Change-Id: I09db00af2ab898d53343167092478f4c2beb3583
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8180a8bdb9a6839c2d51ef7d181a8760eb44ff94)

21 months agofeat(core): Add 3n-snr 78/36678/1
Peter Mikus [Wed, 13 Jul 2022 11:29:59 +0000 (11:29 +0000)]
feat(core): Add 3n-snr

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I2ff6393aa885f03ba52a2cf79d49dac1815e2a86
(cherry picked from commit a6f2f1efe23b31f072a69180f3bfb1d5eeecb018)

21 months agofeat(docs): Update 3n-snr job_specs 77/36677/1
Peter Mikus [Wed, 13 Jul 2022 11:23:06 +0000 (11:23 +0000)]
feat(docs): Update 3n-snr job_specs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1c7ef573038514f1be08ddfc9220df94101c16fb
(cherry picked from commit c084c8e5bda5b402b31391dde8dcd39b273a3b66)

21 months agoReport: Add rls data, fixes 76/36676/1
Tibor Frank [Wed, 13 Jul 2022 08:59:06 +0000 (10:59 +0200)]
Report: Add rls data, fixes

Change-Id: I2639ac5e124ed3c74f92b417e057d1a4e5bd9825
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6533fa595faa39f3b966cc6ee82e99aa48c9a806)

21 months agoReport: Enable pdf 35/36635/1
Tibor Frank [Tue, 12 Jul 2022 09:10:10 +0000 (11:10 +0200)]
Report: Enable pdf

Change-Id: I76ea44800ec4e33cc87b9056c2da03561993328b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0bb57f672c69b7b4ac045c34f706703cb6acf270)

21 months agofix(ansible): 3n-snr 34/36634/1
Peter Mikus [Tue, 12 Jul 2022 08:12:49 +0000 (08:12 +0000)]
fix(ansible): 3n-snr

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iefa417758a34d7c8535cd845470e2a589b3adf57
(cherry picked from commit 7338aede6f3fdb1ac4d9850c18c9960c96051afe)

21 months agoReport: Fixes 33/36633/1
Tibor Frank [Tue, 12 Jul 2022 07:52:12 +0000 (09:52 +0200)]
Report: Fixes

Change-Id: I9a7b26d2f129a1e8e6a251099a0b9ba3f72b8a4e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0459420f21fc6a108cdc121df9d06399faea81e7)

21 months agoReport: Add release data 32/36632/1
Tibor Frank [Tue, 12 Jul 2022 04:46:16 +0000 (06:46 +0200)]
Report: Add release data

Change-Id: I7bb1e9036306e2af406c6b82cf99ddfba1969e16
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 55a5935b667b51da7715794fcf55614f1b7b4517)

21 months agoReport: fixes 31/36631/1
Tibor Frank [Mon, 11 Jul 2022 11:56:45 +0000 (13:56 +0200)]
Report: fixes

Change-Id: I126628ce86999bda15e9c441168711fa44bcb105
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e8862b7fa54f58c9374fde46e791adc9c81eb54f)

21 months agodocs(report): Release notes 22.06 minor update 30/36630/1
Viliam Luc [Mon, 11 Jul 2022 09:04:53 +0000 (11:04 +0200)]
docs(report): Release notes 22.06 minor update

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iada54e78e833fc4e869981dd8192c7b1446e5a4e
(cherry picked from commit 3b0d5244f56ce6a2fb6f9233f650435cee01d7cd)

21 months agoReport: Add release data 28/36628/1
Tibor Frank [Mon, 11 Jul 2022 05:04:06 +0000 (07:04 +0200)]
Report: Add release data

Change-Id: I4464da3f94a950b9fd54b5477789fc5893b462fd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75c54f00bd52623ac97190c5e1f11b9c080afd20)

21 months agoReport: Release data 27/36627/1
Tibor Frank [Sun, 10 Jul 2022 15:39:03 +0000 (17:39 +0200)]
Report: Release data

Change-Id: I033ed5614c2165ea7b07b9721c1ed161c202057c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f14292d2b8f946263ee9160830908050c002c2fc)

21 months agoReport: Add release data 26/36626/1
Tibor Frank [Sun, 10 Jul 2022 15:24:42 +0000 (17:24 +0200)]
Report: Add release data

Change-Id: If1f8da3c7b08cf9a118d2de1be77fd43b04cb56b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3307def2715f5da0a99a502e38630a25a27a5959)

21 months agoReport: Add release data 25/36625/1
Tibor Frank [Fri, 8 Jul 2022 17:02:24 +0000 (19:02 +0200)]
Report: Add release data

Change-Id: I0414581c4e16795748d1dca9aad4d4a4afeb5529
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0d94685eb08196f7dec6f53ccafd7585d8e7ca3d)

21 months agofix(terraform): Migrate to DNS entry 24/36624/1
Peter Mikus [Fri, 8 Jul 2022 13:13:44 +0000 (13:13 +0000)]
fix(terraform): Migrate to DNS entry

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I6b8c9c59ae635b1f4f77b4e3ddc76f753bb32cc3
(cherry picked from commit 0483c9009cec85ef93ab3f3e97640e86ae0c9045)
(cherry picked from commit fa6a57f22b2e575f77c24c7633f4c4df5ac53d00)

21 months agodocs(report): Release notes 22.06 updated 22/36622/1
Viliam Luc [Mon, 27 Jun 2022 09:48:23 +0000 (11:48 +0200)]
docs(report): Release notes 22.06 updated

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I74a9ce97c4cfed7b3c14b3c88bd7330a988c6cf1
(cherry picked from commit 43cc5eb5f6099426fcada5339ee6b2bbc60be58d)

21 months agoPAL: Remove nginx.logs.service.consul from data sources 21/36621/1
Tibor Frank [Fri, 8 Jul 2022 09:41:57 +0000 (11:41 +0200)]
PAL: Remove nginx.logs.service.consul from data sources

Change-Id: Ia3e157f4c9101bafbc6abb37dba4e409d8d9051c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f60636c0db68b0d889cdd4c747cf628f396af963)

21 months agoReport: Add release data 20/36620/1
Tibor Frank [Fri, 8 Jul 2022 09:06:58 +0000 (11:06 +0200)]
Report: Add release data

Change-Id: I0110a78ca13960b97f261a1ea1a12f8baf4c6bc4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 324a2325e01b5b36a0a170a16e3e48d655825838)

21 months agodocs(report): Environment update 19/36619/1
Peter Mikus [Fri, 8 Jul 2022 06:03:18 +0000 (06:03 +0000)]
docs(report): Environment update

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iac1823253e3e91de17d6bdde98168ec51b32f5f9
(cherry picked from commit ba25ef9fb58418e85d0eb34a183d6d9c2323886e)

21 months agoReport: update 3n-alt TG NICs and add picture 18/36618/1
Juraj Linkeš [Thu, 7 Jul 2022 13:43:17 +0000 (15:43 +0200)]
Report: update 3n-alt TG NICs and add picture

Change-Id: I69f48c7c3e74d272da5b784e2cf82e5e4971b705
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 38c3ff73f5cbc0124782c7c7d235ba36f57872ae)

21 months agoReport: Add 3n-icx-e810xxv gtpu tests 16/36616/1
Tibor Frank [Thu, 7 Jul 2022 09:17:06 +0000 (11:17 +0200)]
Report: Add 3n-icx-e810xxv gtpu tests

Change-Id: I622cbc879e432111f68e4fd9a4dde493f362cba3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6b5943bfc4314d2af4b62b1b772eed27bc3b5bd0)

21 months agoReport: Add release data 75/36575/1
Tibor Frank [Thu, 7 Jul 2022 08:35:50 +0000 (10:35 +0200)]
Report: Add release data

Change-Id: If9d60c0b063c520400b028efe46991f4e546920f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2c8d9b777f21c57f1c526ee05b0fd377bec631a3)

21 months agoReport: Add release data 74/36574/1
Tibor Frank [Wed, 6 Jul 2022 11:47:53 +0000 (13:47 +0200)]
Report: Add release data

Change-Id: I37f2acf2662a8cac38fe2a849ab35a9696e6f51c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4458f261feaffaf131b88fb01f02e69be3f4680c)

21 months agoReport: Add Hoststack and VSAP comparison tables 73/36573/1
Tibor Frank [Wed, 6 Jul 2022 11:32:34 +0000 (13:32 +0200)]
Report: Add Hoststack and VSAP comparison tables

Change-Id: Ic4f2fa308c24952694430c72c673c82e0b9cc997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 00e7fb1c447155f3db6cb93fe7a3a049138660de)

21 months agoReport: Add rls data 72/36572/1
Tibor Frank [Wed, 6 Jul 2022 08:05:48 +0000 (10:05 +0200)]
Report: Add rls data

Change-Id: I8891fcfec6cd5805c1be802aa0b47c978e0c3982
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b01ef17f1de1e965383d2353a1ef5316660584e9)

21 months agoReport: Comparison tables 70/36570/1
Tibor Frank [Wed, 29 Jun 2022 14:38:49 +0000 (16:38 +0200)]
Report: Comparison tables

- normalization
- table headers
- legend

Change-Id: Ie095a84b7a62481d01fa5ece7c9da7f320d6d5c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 55cad0badce981ec3f0b544e687d898eba689368)

21 months agofeat(ansible): Add numactl dependency 69/36569/1
Peter Mikus [Fri, 1 Jul 2022 08:04:28 +0000 (08:04 +0000)]
feat(ansible): Add numactl dependency

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7abde98b9d929d6dba35c8b93efb6071fc818b8b
(cherry picked from commit eed8d3731d33161990c3f5f05e22f73826b3f500)

21 months agodocs(report): Update some infra sections 68/36568/1
Peter Mikus [Fri, 1 Jul 2022 07:32:11 +0000 (07:32 +0000)]
docs(report): Update some infra sections

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e7b1b35c3a7036a55d1a78addfde0eebfe7f1be
(cherry picked from commit 0ec89ddbaf81cbcafce7d91ac71e1ab85ca2f913)

21 months agoReport: add 3n-alt static content 67/36567/1
Juraj Linkeš [Thu, 30 Jun 2022 12:20:43 +0000 (14:20 +0200)]
Report: add 3n-alt static content

Also unify the order of testbeds in documents where 3n-alt appears.

Change-Id: I571dc1a2f87f45c4039080b28cfbeeb09d8d990e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit bf0fa247e2e95c14bc76dae43a0df26be410d931)

21 months agoFix typo in aws_ami.rst 66/36566/1
Vratko Polak [Tue, 16 Nov 2021 16:54:08 +0000 (17:54 +0100)]
Fix typo in aws_ami.rst

Change-Id: I501d892c89c6db81e5daf946b357889f7af44631
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit b9dd086436d08c4afd6651fdb46a29473a3db072)

21 months agofeat(infra): Add SNR 65/36565/1
Peter Mikus [Thu, 30 Jun 2022 08:17:31 +0000 (08:17 +0000)]
feat(infra): Add SNR

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e39a59a192682c4bd9ebc7fa81ac727b55cf8e4
(cherry picked from commit 8485f3bf773ad3b6ec4426dd2465b356b41c5a06)

21 months agolab: update 3n-alt docs 64/36564/1
Juraj Linkeš [Mon, 14 Mar 2022 13:46:47 +0000 (14:46 +0100)]
lab: update 3n-alt docs

Change-Id: I6c77f633bfcae3b342d211a6b6379acb2f1adb6a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 7b06cddf4f0ceca580b71b695e34a39e706931fc)

21 months agojob-spec: Reduce number of iterative tests for 2n-clx 63/36563/1
Tibor Frank [Thu, 30 Jun 2022 08:59:01 +0000 (10:59 +0200)]
job-spec: Reduce number of iterative tests for 2n-clx

- For e810cq remove dpdk-vfio-pci L2 100k and 1M scale tests

Change-Id: Icded4fdca2720fad7f51cd072ed72fc4a1b4742d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 339628cdb5be2e4e488579a95c9f0c3eb3268bc4)

21 months agofeat(methodology): add methodology for autogen 62/36562/1
Vratko Polak [Tue, 28 Jun 2022 10:36:17 +0000 (12:36 +0200)]
feat(methodology): add methodology for autogen

Change-Id: I416c4120f2d7e05582a1f4fc529dfc86a09a7788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 44ff812b59a8cdcb3ac97cbda528e84e74b3547f)

21 months agofeat(doc): update ASTF related methodology 61/36561/1
Vratko Polak [Tue, 28 Jun 2022 15:59:59 +0000 (17:59 +0200)]
feat(doc): update ASTF related methodology

Also added some TODOs for future methodology improvements.
Some of them will addressed in subsequent changes soon,
but not sure yet which ones exactly.

Change-Id: Ib827371b7d7a598c5fa6ab41fb7e48c73185844f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 2db1998c0432569702738524e66c9d4e3f553b20)

21 months agojob_specs: add wireguard perf tests to regression 59/36559/3
Yulong Pei [Mon, 27 Jun 2022 05:27:48 +0000 (05:27 +0000)]
job_specs: add wireguard perf tests to regression

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f
(cherry picked from commit 325cef50672aed697e277405fe9bb9b797d02701)

21 months agoAdd Test Suite for VPP WireGuard 60/36560/1
Cui,Cheng [Thu, 19 May 2022 06:48:04 +0000 (06:48 +0000)]
Add Test Suite for VPP WireGuard

Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
(cherry picked from commit 75ef277536c43096e7646430568d97d2cc489238)

21 months agoUpdate VPP_STABLE_VER files 56/36556/3
Tibor Frank [Thu, 30 Jun 2022 04:30:54 +0000 (04:30 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ia2b760ca18758eaec048cfb1c6206af1ba224c59
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agojob_specs: add IPsec perf tests and GTPU perf tests to regression 58/36558/1
Yulong Pei [Fri, 24 Jun 2022 01:25:12 +0000 (01:25 +0000)]
job_specs: add IPsec perf tests and GTPU perf tests to regression

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: If70f910003d8208e08d4dc101ac70b33e7e4162b
(cherry picked from commit d0099eacdcbaeb7fcc80592daf350e4f0e7b3936)

21 months agojob-spec: Reduce number of iterative tests for 2n-clx 57/36557/1
Tibor Frank [Wed, 29 Jun 2022 12:40:09 +0000 (14:40 +0200)]
job-spec: Reduce number of iterative tests for 2n-clx

- For e810cq use the same dpdk-vfio-pci tests as for xxv710

Change-Id: I5857332fa8f2256b293efd610902d30a015e716d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f323eea4adbddff526ee49f0752d9dbc5396091e)

21 months agofeat(telemetry): print executed command in vppctl 34/36534/1
Vratko Polak [Tue, 28 Jun 2022 15:33:55 +0000 (17:33 +0200)]
feat(telemetry): print executed command in vppctl

The vpp bundle does that, so this will make the outputs more similar.

Change-Id: Iadad9b683d90b7bdd672ed3f51bce9f57f652eaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 71d84bb6f1f493ce589499a6de149cfa3222e006)

21 months agoReport: Add rc2, re-test data 33/36533/1
Tibor Frank [Wed, 29 Jun 2022 08:47:17 +0000 (10:47 +0200)]
Report: Add rc2, re-test data

Change-Id: I3fe5d3a1b5fcb8ab182442d6af85719b16e52fe0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 30badc023cb58f7ae4ddcf747c28f49c39b1dca6)

21 months agoReport: Add rc2 data 27/36527/1
Tibor Frank [Tue, 28 Jun 2022 11:40:06 +0000 (13:40 +0200)]
Report: Add rc2 data

Change-Id: Ie5df83a47c352ef84486c2d62be91365ad005409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8335a5a3f8935e6f1ab760986ac715c22839ca7a)

21 months agofeat(telemetry): Rework 26/36526/1
Peter Mikus [Fri, 24 Jun 2022 10:32:28 +0000 (10:32 +0000)]
feat(telemetry): Rework

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0a84ce88b318c488ba2d519b20237c88b9f9f1e6
(cherry picked from commit b33b1461fe815b1a09267118644538a5b9351c60)

21 months agoReport: Add normalized comp tabels - static content 25/36525/1
Tibor Frank [Tue, 28 Jun 2022 08:11:33 +0000 (10:11 +0200)]
Report: Add normalized comp tabels - static content

Change-Id: I0a9782248fee91f3db2fb5db00c800c7e5447f32
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e076cc8c47e7c10a48d0c5410967cd0269b98723)

21 months agoReport: Add normalized comparison tables 24/36524/1
Tibor Frank [Tue, 28 Jun 2022 07:24:31 +0000 (09:24 +0200)]
Report: Add normalized comparison tables

Change-Id: Ief631c4b8924885642435669a151be9f9c9e585f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9748f8e1b20bc528fb0143a08f111f48426ada3e)

21 months agoReport: Add rc2 data 23/36523/1
Tibor Frank [Tue, 28 Jun 2022 05:06:51 +0000 (07:06 +0200)]
Report: Add rc2 data

Change-Id: Ia5c242d8904b2f8b7e774ce4cec421e58b84a2ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 050e8699a96175ecda2dc696dbe63dbafc783812)

21 months agoTrending: Add names of new ICX TBs 21/36521/1
Tibor Frank [Mon, 27 Jun 2022 13:54:56 +0000 (15:54 +0200)]
Trending: Add names of new ICX TBs

Change-Id: Ic5b708a935272fda935398fe7f0ab53de72c5eba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 75a332d56cfbcf9e824e4c3bfa3ff87893d9033a)

21 months agofix(ansible): ICX rules 20/36520/1
Peter Mikus [Mon, 27 Jun 2022 12:08:28 +0000 (12:08 +0000)]
fix(ansible): ICX rules

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4b9fdeac0e4ec85cf0def7cfeefbf2ce4e7b0bd9
(cherry picked from commit d428ea995298bc82237b3309609c4abab9cf04e2)

21 months agofix(infra): Topology 3n-icx 18/36518/1
Peter Mikus [Mon, 27 Jun 2022 10:17:39 +0000 (10:17 +0000)]
fix(infra): Topology 3n-icx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibdf60c87dd56282d7c10eb94efd0914aa5944bbd
(cherry picked from commit f99fee38be3f0a15bdc52f7672a35c21fc9d89de)

21 months agoReport: Add VSAP tests 17/36517/1
Tibor Frank [Mon, 27 Jun 2022 08:51:23 +0000 (10:51 +0200)]
Report: Add VSAP tests

Change-Id: If0ebb92ded94bf2b0cf8ad0d17ac2b0bd6d165a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7fd5509ba966027c118d3930e7b20d5c080faa9a)

21 months agoReport: Add rc2 data 16/36516/1
Tibor Frank [Mon, 27 Jun 2022 05:02:39 +0000 (07:02 +0200)]
Report: Add rc2 data

Change-Id: I8b69a5029a200c327e7276675c847809af367908
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0f3f40e1c2857daff628a9e2280a2de00c6f9331)

21 months agoReport: Add rc2 data 75/36475/1
Tibor Frank [Fri, 24 Jun 2022 10:37:18 +0000 (12:37 +0200)]
Report: Add rc2 data

Change-Id: Iad3cb32e346bf6c7e0754275e5ccba6cb19b731a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7909919cf42d6835d284dc6fbe9dfb3498784c20)

21 months agoReport: Add rc2 data 74/36474/1
Tibor Frank [Fri, 24 Jun 2022 07:49:48 +0000 (09:49 +0200)]
Report: Add rc2 data

Change-Id: Ifaecbf2f1788cc0da44b4ef64abc63b531f161c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7f99e1ae98fc222b35f94445921ce656206e6689)

21 months agofix(infra): Topology file 73/36473/1
Peter Mikus [Thu, 23 Jun 2022 12:19:27 +0000 (12:19 +0000)]
fix(infra): Topology file

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47cc26d500e088154ffe88aceb384128a78b70ee
(cherry picked from commit 50053fbdc3de57026b940242a445ed39b4be49f8)

21 months agofeat(infra): Add ICX 72/36472/1
Peter Mikus [Wed, 22 Jun 2022 14:51:23 +0000 (14:51 +0000)]
feat(infra): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I609e039026bf5cd71a06549caa0ba917579e525c
(cherry picked from commit d8449a2d2b64566b4e3d30879305119d1c500d59)

21 months agoReport: Add rc2 data 71/36471/1
Tibor Frank [Thu, 23 Jun 2022 08:06:33 +0000 (10:06 +0200)]
Report: Add rc2 data

Change-Id: Ia8a81135cb0dbd3b2f8877de66a5d9ed3f6e8309
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bb734f5c497c9329d6cd28d0fbb0bff3ba1992cc)

21 months agofix: 3n-alt missing in regressions and progressions 70/36470/1
Viliam Luc [Wed, 22 Jun 2022 13:39:55 +0000 (15:39 +0200)]
fix: 3n-alt missing in regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8b2cdf6f8dc45cae9a921c1ecbd2e952ef30bfbe
(cherry picked from commit a28b496bafd3c7a951e4732b4bd42182d8ab2d69)

21 months agofeat(ansible): Add ICX 68/36468/1
Peter Mikus [Wed, 22 Jun 2022 11:01:17 +0000 (11:01 +0000)]
feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3a62dc7048102381598b3e0dfc16f82fad834d7b
(cherry picked from commit 99a0ec18cb9117e9c22b4416c97d603215e3fa8b)

21 months agoReport: Add 2n-clx-e810cq latency 67/36467/1
Tibor Frank [Wed, 22 Jun 2022 08:46:41 +0000 (10:46 +0200)]
Report: Add 2n-clx-e810cq latency

Change-Id: I5674d40362ea958c34845c22c1b5fd090d08be83
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0fa376d390b3de02c75e4611c1e9d134e49b5b9d)

21 months agofeat(doc): Infra updates 66/36466/1
Peter Mikus [Wed, 22 Jun 2022 07:21:15 +0000 (07:21 +0000)]
feat(doc): Infra updates

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I208fc73382754d3182f6f7eedc1a46ae72ef6aa2
(cherry picked from commit ce081da3605b234cf257db52a083e15022f06de4)

21 months agofix(hoststack): distinguish two tcp tag types 02/36402/2
Vratko Polak [Fri, 10 Jun 2022 14:01:22 +0000 (16:01 +0200)]
fix(hoststack): distinguish two tcp tag types

Previous change did not consider TCP_PPS and TCP_CPS robot tags
are used by two different suite types (hoststack or ASTF).
This fixes the unintended impact on hoststack.

+ Add HOSTSTACK tag to VSAP suites.
 - They could also get VSAP tag, but not needed for this Change.

Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a

Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit f3a55b00e3f9e3418426c295cc6f9810a6eb137e)

21 months agoReport: Comparisons 65/36465/1
Tibor Frank [Tue, 21 Jun 2022 12:05:28 +0000 (14:05 +0200)]
Report: Comparisons

Change-Id: Icbb4709c84b66251438b73d109606977527c6c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d0a30297017d1e947c3540ca81b00599ea77825e)

21 months agoReport: Add 2n-clx-e810cq 64/36464/1
Tibor Frank [Tue, 21 Jun 2022 11:36:54 +0000 (13:36 +0200)]
Report: Add 2n-clx-e810cq

Change-Id: I4c7f37d77a9b8bda17eb3fb0b9a5bf468f1fd853
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0807c16320ff5c864dd77168e2b8a36556a941d4)

21 months agofeat(pxe): Add ICX 63/36463/1
Peter Mikus [Fri, 17 Jun 2022 11:55:49 +0000 (11:55 +0000)]
feat(pxe): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e3ec03a87f356c0e588011b848f8dd4ab7f30aa
(cherry picked from commit 5fc677579d18ec73390fa5ec86dc9168da3245f6)

21 months agoTrending: Add 2n-clx-e810cq - fixes 61/36461/1
Tibor Frank [Tue, 21 Jun 2022 08:27:59 +0000 (10:27 +0200)]
Trending: Add 2n-clx-e810cq - fixes

Change-Id: I9789e459c3db272e8f76c25df1ced266c9f5213f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4e6de308248a9aadd54f0183740bbe807cf9e985)

21 months agoTrending: Add 2n-clx-e810cq 59/36459/1
Tibor Frank [Tue, 21 Jun 2022 08:01:26 +0000 (10:01 +0200)]
Trending: Add 2n-clx-e810cq

Change-Id: Iefcd777f2e51038c4efc13ff68c777efb7ed78c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6a559c656f42c2122458338125ba5da68f8cdcad)

21 months agofix: testpmd and l3fwd check state 57/36457/1
Viliam Luc [Mon, 13 Jun 2022 11:42:29 +0000 (13:42 +0200)]
fix: testpmd and l3fwd check state
     + print testpmd and l3fwd pid after start

Testpmd and l3fwd utility can be started but link might not be
ready yet. This fix start the utility on all DUTs and do the
check later.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6
(cherry picked from commit 5c4c05c8ea9f1b07862c09c8d971a3dae3b16adf)

21 months agoAdd ipsec policy test suites with flow director or rss accelerated 56/36456/1
Yulong Pei [Wed, 11 May 2022 04:29:50 +0000 (04:29 +0000)]
Add ipsec policy test suites with flow director or rss accelerated

The test scenario is about two private networks which communication was
protected by ipsec.

The test suites are to show performance impovement about ipsec esp flow
lookup that offloaded by NIC flow director and rss.

Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet
flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T.

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9
(cherry picked from commit f7ee014dee09b4089924342b0fe5654b2fe91e90)

21 months agodoc(infra): ICX onboarding 15/36415/1
Peter Mikus [Wed, 15 Jun 2022 13:44:17 +0000 (13:44 +0000)]
doc(infra): ICX onboarding

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I542a16dcc1f00b0cc2a9f1bce873b0e67d60b69e
(cherry picked from commit 7f1c5531d5f2b04b43ba84964a82f72e74469a59)

22 months agoUpdate VPP_STABLE_VER files 14/36414/2
Tibor Frank [Thu, 16 Jun 2022 06:58:23 +0000 (06:58 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib6247374f12b5a25432407870bf9135c6196c725
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofeat(jobspec): Avoid tests affected by CSIT-1830 13/36413/1
Vratko Polak [Wed, 8 Jun 2022 08:42:26 +0000 (10:42 +0200)]
feat(jobspec): Avoid tests affected by CSIT-1830

+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones.
 + Keep UDP TPUT tests at 100b for now.
+ Add both 100b and 1518b TCP TPUT tests to Denverton.
 + Its x553 NIC is not affected.
 + That gives us some comparison on how packet size affects performance.

Ticket: CSIT-1830

Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 5d412da6bf08a042765eabfea91e9484a8daba11)

22 months agofeat(tests): Remove PPS tests. 12/36412/1
Vratko Polak [Wed, 8 Jun 2022 08:39:49 +0000 (10:39 +0200)]
feat(tests): Remove PPS tests.

+ Delete nat44 pps suites.
+ Rename ip4base suites, testcases, suite tags (also tg) to -tput.
 + Also robot tags like UDP_PPS and TCP_PPS.
- Keep traffic types and traffic profile names with pps.
 + They can be renamed in a different change if needed.
+ Update job specs.
- Do not update methodology yet (avoid conflict with another Change).

Ticket: CSIT-1829

Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 158f54ff4d416c9bd282ffd0b8e812ec4e8214f4)

22 months agofeat(infra): SnowRidge docs 11/36411/1
Peter Mikus [Wed, 18 May 2022 09:57:02 +0000 (11:57 +0200)]
feat(infra): SnowRidge docs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie53e1e7474542547d73bdfe2a234e6e838bdd454
(cherry picked from commit 9f9e8be234eb422f189a6b3bc008963be7f1b213)

22 months agodoc(report): Update test environment 09/36409/1
Peter Mikus [Tue, 14 Jun 2022 11:14:49 +0000 (11:14 +0000)]
doc(report): Update test environment

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73
(cherry picked from commit 1b97d7088f4db702b05c0fd4cbc02a52c97e4529)

22 months agofix(infra): Topopology link swap 07/36407/1
Peter Mikus [Tue, 14 Jun 2022 09:53:03 +0000 (09:53 +0000)]
fix(infra): Topopology link swap

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212
(cherry picked from commit 04288f6c4806fad01710225e4c4b789704e399d7)

22 months agotrending: fix 3n-alt missing in dashboard 06/36406/1
Viliam Luc [Tue, 14 Jun 2022 08:30:17 +0000 (10:30 +0200)]
trending: fix 3n-alt missing in dashboard

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d
(cherry picked from commit a08e07a8f6c614899b85f891efd45d5e4e93f7f4)

22 months agofeat(dpdk): Bump the version within VM 04/36404/1
Peter Mikus [Mon, 13 Jun 2022 08:16:04 +0000 (08:16 +0000)]
feat(dpdk): Bump the version within VM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1
(cherry picked from commit 7e88ea8b9a31713be65587672f4fe22bccb5f386)

22 months agodoc(infra): Fix firmware versions 03/36403/1
Peter Mikus [Mon, 13 Jun 2022 05:57:02 +0000 (05:57 +0000)]
doc(infra): Fix firmware versions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I755043bc10b2bc419daf007f023742e814c3c63b
(cherry picked from commit e483990fff726fca8ec6a70fe202ab790517eddd)

22 months agoUpdate VPP_STABLE_VER files 01/36401/2
Tibor Frank [Mon, 13 Jun 2022 04:26:09 +0000 (04:26 +0000)]
Update VPP_STABLE_VER files

Change-Id: I1ed61d9d807d2b8e66555deb26456017597cb9ae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofix(core): T-Rex initialization 62/36362/1
Peter Mikus [Thu, 9 Jun 2022 09:45:26 +0000 (09:45 +0000)]
fix(core): T-Rex initialization

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95

22 months agoReport: Add retest data 61/36361/1
Tibor Frank [Thu, 9 Jun 2022 09:43:11 +0000 (11:43 +0200)]
Report: Add retest data

Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 400205b1f838b88e72236559308d9c4b3ee61aa4)

22 months agofix(infra): 2n-clx links and docs 60/36360/1
Peter Mikus [Wed, 8 Jun 2022 12:35:04 +0000 (12:35 +0000)]
fix(infra): 2n-clx links and docs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iac1743da3eb51c69c67e8496ad4145dcc616341c
(cherry picked from commit 13a3991322bc77e5bc88c6b3970c191adb487f7d)

22 months agoReport: Add dpdk and re-test data 59/36359/1
Tibor Frank [Wed, 8 Jun 2022 08:49:08 +0000 (10:49 +0200)]
Report: Add dpdk and re-test data

Change-Id: Ia078a30f467c9a0eac45a58b83dd82975b815b5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3ea1e99ccb945344050ecd8f186a3d502ac51d28)

22 months agofix(infra): Temporarily disable X710 link loop 58/36358/1
Peter Mikus [Tue, 7 Jun 2022 08:20:45 +0000 (10:20 +0200)]
fix(infra): Temporarily disable X710 link loop

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4a8eb282754a5689cd538653e34bbc456e198f94
(cherry picked from commit 9d676f47078716600bd81504065755939c06d14a)

22 months agoReport: Add rc1, re-test, dpdk data 57/36357/1
Tibor Frank [Tue, 7 Jun 2022 05:29:50 +0000 (07:29 +0200)]
Report: Add rc1, re-test, dpdk data

Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8b91420cd22bca6203ac43aa09d1f227dacdaec4)