csit.git
21 months agoReport: Add release data 02/36602/1
Tibor Frank [Thu, 7 Jul 2022 08:35:50 +0000 (10:35 +0200)]
Report: Add release data

Change-Id: If9d60c0b063c520400b028efe46991f4e546920f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(pxe): Add Ubuntu Jammy 99/36599/3
Peter Mikus [Wed, 6 Jul 2022 14:11:01 +0000 (14:11 +0000)]
feat(pxe): Add Ubuntu Jammy

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ic9ba874d62442c0a1c803a29d1072e7dd85b7d57

21 months agoReport: Add release data 96/36596/1
Tibor Frank [Wed, 6 Jul 2022 11:47:53 +0000 (13:47 +0200)]
Report: Add release data

Change-Id: I37f2acf2662a8cac38fe2a849ab35a9696e6f51c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add Hoststack and VSAP comparison tables 95/36595/2
Tibor Frank [Wed, 6 Jul 2022 11:32:34 +0000 (13:32 +0200)]
Report: Add Hoststack and VSAP comparison tables

Change-Id: Ic4f2fa308c24952694430c72c673c82e0b9cc997
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(pxe): Add s89-t39t310-tg1 94/36594/2
Peter Mikus [Wed, 6 Jul 2022 08:36:07 +0000 (08:36 +0000)]
feat(pxe): Add s89-t39t310-tg1

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9e4bffaad70bdcfe03b184e14c965583814b9da1

21 months agoReport: Add rls data 93/36593/2
Tibor Frank [Wed, 6 Jul 2022 08:05:48 +0000 (10:05 +0200)]
Report: Add rls data

Change-Id: I8891fcfec6cd5805c1be802aa0b47c978e0c3982
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoUpdate VPP_STABLE_VER files 71/36571/2
Tibor Frank [Wed, 6 Jul 2022 04:48:51 +0000 (04:48 +0000)]
Update VPP_STABLE_VER files

Change-Id: I089dee9bab58c260d0d26e9aa099770823b306ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Comparison tables 45/36545/3
Tibor Frank [Wed, 29 Jun 2022 14:38:49 +0000 (16:38 +0200)]
Report: Comparison tables

- normalization
- table headers
- legend

Change-Id: Ie095a84b7a62481d01fa5ece7c9da7f320d6d5c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(ansible): Add numactl dependency 80/36580/1
Peter Mikus [Fri, 1 Jul 2022 08:04:28 +0000 (08:04 +0000)]
feat(ansible): Add numactl dependency

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I7abde98b9d929d6dba35c8b93efb6071fc818b8b

21 months agodocs(report): Update some infra sections 79/36579/1
Peter Mikus [Fri, 1 Jul 2022 07:32:11 +0000 (07:32 +0000)]
docs(report): Update some infra sections

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e7b1b35c3a7036a55d1a78addfde0eebfe7f1be

21 months agoReport: add 3n-alt static content 77/36577/2
Juraj Linkeš [Thu, 30 Jun 2022 12:20:43 +0000 (14:20 +0200)]
Report: add 3n-alt static content

Also unify the order of testbeds in documents where 3n-alt appears.

Change-Id: I571dc1a2f87f45c4039080b28cfbeeb09d8d990e
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
21 months agoFix typo in aws_ami.rst 34/34534/3
Vratko Polak [Tue, 16 Nov 2021 16:54:08 +0000 (17:54 +0100)]
Fix typo in aws_ami.rst

Change-Id: I501d892c89c6db81e5daf946b357889f7af44631
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agofeat(infra): Add SNR 50/36550/3
Peter Mikus [Thu, 30 Jun 2022 08:17:31 +0000 (08:17 +0000)]
feat(infra): Add SNR

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e39a59a192682c4bd9ebc7fa81ac727b55cf8e4

21 months agolab: update 3n-alt docs 41/35641/5
Juraj Linkeš [Mon, 14 Mar 2022 13:46:47 +0000 (14:46 +0100)]
lab: update 3n-alt docs

Change-Id: I6c77f633bfcae3b342d211a6b6379acb2f1adb6a
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
21 months agojob-spec: Reduce number of iterative tests for 2n-clx 51/36551/1
Tibor Frank [Thu, 30 Jun 2022 08:59:01 +0000 (10:59 +0200)]
job-spec: Reduce number of iterative tests for 2n-clx

- For e810cq remove dpdk-vfio-pci L2 100k and 1M scale tests

Change-Id: Icded4fdca2720fad7f51cd072ed72fc4a1b4742d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(doc): update ASTF related methodology 15/36015/9
Vratko Polak [Tue, 28 Jun 2022 15:59:59 +0000 (17:59 +0200)]
feat(doc): update ASTF related methodology

Also added some TODOs for future methodology improvements.
Some of them will addressed in subsequent changes soon,
but not sure yet which ones exactly.

Change-Id: Ib827371b7d7a598c5fa6ab41fb7e48c73185844f
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agofeat(methodology): add methodology for autogen 74/36174/4
Vratko Polak [Tue, 28 Jun 2022 10:36:17 +0000 (12:36 +0200)]
feat(methodology): add methodology for autogen

Change-Id: I416c4120f2d7e05582a1f4fc529dfc86a09a7788
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agostyle(tox): prepare for fixer scripts 53/35153/2
Vratko Polak [Mon, 31 Jan 2022 14:24:53 +0000 (15:24 +0100)]
style(tox): prepare for fixer scripts

The previous code assumes each tox script is a checker.
We want to add fixer scripts (not voting but editing) soon.

This is the less interesting part of the process,
renaming things and updating comments.

Includes some basic descriptions of how fixers differ from checkers.

Change-Id: I1ca1572a328acd02b41dcf4e70d7cb3746a03b03
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agojob_specs: add wireguard perf tests to regression 49/36549/1
Yulong Pei [Mon, 27 Jun 2022 05:27:48 +0000 (05:27 +0000)]
job_specs: add wireguard perf tests to regression

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I9e499df973fd9990ab02fe7008d12e78b2ab089f

21 months agojob_specs: add IPsec perf tests and GTPU perf tests to regression 91/36491/6
Yulong Pei [Fri, 24 Jun 2022 01:25:12 +0000 (01:25 +0000)]
job_specs: add IPsec perf tests and GTPU perf tests to regression

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: If70f910003d8208e08d4dc101ac70b33e7e4162b

21 months agojob-spec: Reduce number of iterative tests for 2n-clx 44/36544/1
Tibor Frank [Wed, 29 Jun 2022 12:40:09 +0000 (14:40 +0200)]
job-spec: Reduce number of iterative tests for 2n-clx

- For e810cq use the same dpdk-vfio-pci tests as for xxv710

Change-Id: I5857332fa8f2256b293efd610902d30a015e716d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoUTI: Add comments and clean the code. 40/36440/3
Tibor Frank [Wed, 15 Jun 2022 12:29:02 +0000 (14:29 +0200)]
UTI: Add comments and clean the code.

Change-Id: I6fba9aac20ed22c2ae1450161edc8c11ffa1e24d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoUTI: Colors in iteraive graphs 41/36541/2
Tibor Frank [Wed, 29 Jun 2022 11:12:42 +0000 (13:12 +0200)]
UTI: Colors in iteraive graphs

Change-Id: I060668104a20235711a3a72eca83e446919d4ce2
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(telemetry): print executed command in vppctl 12/36512/2
Vratko Polak [Tue, 28 Jun 2022 15:33:55 +0000 (17:33 +0200)]
feat(telemetry): print executed command in vppctl

The vpp bundle does that, so this will make the outputs more similar.

Change-Id: Iadad9b683d90b7bdd672ed3f51bce9f57f652eaa
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agoReport: Add rc2, re-test data 39/36539/1
Tibor Frank [Wed, 29 Jun 2022 08:47:17 +0000 (10:47 +0200)]
Report: Add rc2, re-test data

Change-Id: I3fe5d3a1b5fcb8ab182442d6af85719b16e52fe0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add rc2 data 11/36511/2
Tibor Frank [Tue, 28 Jun 2022 11:40:06 +0000 (13:40 +0200)]
Report: Add rc2 data

Change-Id: Ie5df83a47c352ef84486c2d62be91365ad005409
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(telemetry): Rework 95/36495/16
Peter Mikus [Fri, 24 Jun 2022 10:32:28 +0000 (10:32 +0000)]
feat(telemetry): Rework

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I0a84ce88b318c488ba2d519b20237c88b9f9f1e6

21 months agoReport: Add normalized comp tabels - static content 09/36509/2
Tibor Frank [Tue, 28 Jun 2022 08:11:33 +0000 (10:11 +0200)]
Report: Add normalized comp tabels - static content

Change-Id: I0a9782248fee91f3db2fb5db00c800c7e5447f32
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add normalized comparison tables 08/36508/3
Tibor Frank [Tue, 28 Jun 2022 07:24:31 +0000 (09:24 +0200)]
Report: Add normalized comparison tables

Change-Id: Ief631c4b8924885642435669a151be9f9c9e585f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add rc2 data 07/36507/1
Tibor Frank [Tue, 28 Jun 2022 05:06:51 +0000 (07:06 +0200)]
Report: Add rc2 data

Change-Id: Ia5c242d8904b2f8b7e774ce4cec421e58b84a2ed
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoTrending: Add names of new ICX TBs 04/36504/1
Tibor Frank [Mon, 27 Jun 2022 13:54:56 +0000 (15:54 +0200)]
Trending: Add names of new ICX TBs

Change-Id: Ic5b708a935272fda935398fe7f0ab53de72c5eba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofix(ansible): ICX rules 02/36502/1
Peter Mikus [Mon, 27 Jun 2022 12:08:28 +0000 (12:08 +0000)]
fix(ansible): ICX rules

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4b9fdeac0e4ec85cf0def7cfeefbf2ce4e7b0bd9

21 months agofix(infra): Topology 3n-icx 00/36500/1
Peter Mikus [Mon, 27 Jun 2022 10:17:39 +0000 (10:17 +0000)]
fix(infra): Topology 3n-icx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ibdf60c87dd56282d7c10eb94efd0914aa5944bbd

21 months agoReport: Add VSAP tests 98/36498/1
Tibor Frank [Mon, 27 Jun 2022 08:51:23 +0000 (10:51 +0200)]
Report: Add VSAP tests

Change-Id: If0ebb92ded94bf2b0cf8ad0d17ac2b0bd6d165a3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add rc2 data 97/36497/1
Tibor Frank [Mon, 27 Jun 2022 05:02:39 +0000 (07:02 +0200)]
Report: Add rc2 data

Change-Id: I8b69a5029a200c327e7276675c847809af367908
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add rc2 data 96/36496/1
Tibor Frank [Fri, 24 Jun 2022 10:37:18 +0000 (12:37 +0200)]
Report: Add rc2 data

Change-Id: Iad3cb32e346bf6c7e0754275e5ccba6cb19b731a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add rc2 data 93/36493/1
Tibor Frank [Fri, 24 Jun 2022 07:49:48 +0000 (09:49 +0200)]
Report: Add rc2 data

Change-Id: Ifaecbf2f1788cc0da44b4ef64abc63b531f161c8
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofix(infra): Topology file 90/36490/1
Peter Mikus [Thu, 23 Jun 2022 12:19:27 +0000 (12:19 +0000)]
fix(infra): Topology file

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I47cc26d500e088154ffe88aceb384128a78b70ee

21 months agofeat(infra): Add ICX 89/36489/2
Peter Mikus [Wed, 22 Jun 2022 14:51:23 +0000 (14:51 +0000)]
feat(infra): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I609e039026bf5cd71a06549caa0ba917579e525c

21 months agochore(mtu): delete some unused keywords related to mtu 70/35270/9
Vratko Polak [Thu, 19 May 2022 08:09:19 +0000 (10:09 +0200)]
chore(mtu): delete some unused keywords related to mtu

Change-Id: Id80b5611bb9a5d4398d4b2d00e92cda469949607
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agoReport: Add rc2 data 87/36487/3
Tibor Frank [Thu, 23 Jun 2022 08:06:33 +0000 (10:06 +0200)]
Report: Add rc2 data

Change-Id: Ia8a81135cb0dbd3b2f8877de66a5d9ed3f6e8309
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofix: 3n-alt missing in regressions and progressions 85/36485/1
Viliam Luc [Wed, 22 Jun 2022 13:39:55 +0000 (15:39 +0200)]
fix: 3n-alt missing in regressions and progressions

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I8b2cdf6f8dc45cae9a921c1ecbd2e952ef30bfbe

21 months agofeat(ansible): Add ICX 83/36483/2
Peter Mikus [Wed, 22 Jun 2022 11:01:17 +0000 (11:01 +0000)]
feat(ansible): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I3a62dc7048102381598b3e0dfc16f82fad834d7b

21 months agoReport: Add 2n-clx-e810cq latency 82/36482/2
Tibor Frank [Wed, 22 Jun 2022 08:46:41 +0000 (10:46 +0200)]
Report: Add 2n-clx-e810cq latency

Change-Id: I5674d40362ea958c34845c22c1b5fd090d08be83
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(doc): Infra updates 81/36481/2
Peter Mikus [Wed, 22 Jun 2022 07:21:15 +0000 (07:21 +0000)]
feat(doc): Infra updates

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I208fc73382754d3182f6f7eedc1a46ae72ef6aa2

21 months agoReport: Comparisons 79/36479/1
Tibor Frank [Tue, 21 Jun 2022 12:05:28 +0000 (14:05 +0200)]
Report: Comparisons

Change-Id: Icbb4709c84b66251438b73d109606977527c6c88
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoReport: Add 2n-clx-e810cq 78/36478/2
Tibor Frank [Tue, 21 Jun 2022 11:36:54 +0000 (13:36 +0200)]
Report: Add 2n-clx-e810cq

Change-Id: I4c7f37d77a9b8bda17eb3fb0b9a5bf468f1fd853
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoUpdate VPP_STABLE_VER files 62/36462/3
Tibor Frank [Tue, 21 Jun 2022 08:33:36 +0000 (08:33 +0000)]
Update VPP_STABLE_VER files

Change-Id: Iea2b40aa5df6a96fd26f1d85f23dd6d304a7ca8e
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofeat(pxe): Add ICX 50/36450/4
Peter Mikus [Fri, 17 Jun 2022 11:55:49 +0000 (11:55 +0000)]
feat(pxe): Add ICX

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4e3ec03a87f356c0e588011b848f8dd4ab7f30aa

21 months agoTrending: Add 2n-clx-e810cq - fixes 77/36477/1
Tibor Frank [Tue, 21 Jun 2022 08:27:59 +0000 (10:27 +0200)]
Trending: Add 2n-clx-e810cq - fixes

Change-Id: I9789e459c3db272e8f76c25df1ced266c9f5213f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agoTrending: Add 2n-clx-e810cq 55/36455/2
Tibor Frank [Tue, 21 Jun 2022 08:01:26 +0000 (10:01 +0200)]
Trending: Add 2n-clx-e810cq

Change-Id: Iefcd777f2e51038c4efc13ff68c777efb7ed78c9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
21 months agofix(uti): export correct units in cps ndrpdr 22/36022/4
Vratko Polak [Fri, 22 Apr 2022 11:29:06 +0000 (13:29 +0200)]
fix(uti): export correct units in cps ndrpdr

Compute Bandwidth keyword returns value in Gbps,
as that is convenient for test messages.
Export Search Bound keyword expects value in bps,
as that is convenient for JSON export.

While the conversion was present in
Display Single PPS Bound keyword, it was missing from
Display Single CPS Bound keyword. Now added.

Change-Id: I5bb5934beeecfa2ee1b77dd1b1bfc788d034c845
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
21 months agostyle(robot): capitalize two keywords properly 23/36023/3
Vratko Polak [Fri, 22 Apr 2022 11:27:48 +0000 (13:27 +0200)]
style(robot): capitalize two keywords properly

This is just to make the subsequent fix more readable.

Change-Id: I7cebcaed3f658cd026f05713ea2f94dce60786c0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agofix: testpmd and l3fwd check state 31/36431/18
Viliam Luc [Mon, 13 Jun 2022 11:42:29 +0000 (13:42 +0200)]
fix: testpmd and l3fwd check state
     + print testpmd and l3fwd pid after start

Testpmd and l3fwd utility can be started but link might not be
ready yet. This fix start the utility on all DUTs and do the
check later.

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: If476e22f206d9a6a0dd399879a88eafedca92bb6

22 months agoAdd ipsec policy test suites with flow director or rss accelerated 19/36119/8
Yulong Pei [Wed, 11 May 2022 04:29:50 +0000 (04:29 +0000)]
Add ipsec policy test suites with flow director or rss accelerated

The test scenario is about two private networks which communication was
protected by ipsec.

The test suites are to show performance impovement about ipsec esp flow
lookup that offloaded by NIC flow director and rss.

Verified on 3n-clx and Intel E810 NIC environment, with 64B ipsec packet
flow, performance improved ~31% with 1C2T, ~110% with 2C4T, ~250% with 4C8T.

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Signed-off-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: I30aec8c5115e5a6fbef88c11d1bef2624029d1b9

22 months agodoc(infra): ICX onboarding 41/36441/3
Peter Mikus [Wed, 15 Jun 2022 13:44:17 +0000 (13:44 +0000)]
doc(infra): ICX onboarding

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I542a16dcc1f00b0cc2a9f1bce873b0e67d60b69e

22 months agofeat(jobspec): Avoid tests affected by CSIT-1830 45/36345/3
Vratko Polak [Wed, 8 Jun 2022 08:42:26 +0000 (10:42 +0200)]
feat(jobspec): Avoid tests affected by CSIT-1830

+ Replace TCP TPUT 100b tests on xxv710 NICs with 1518b ones.
 + Keep UDP TPUT tests at 100b for now.
+ Add both 100b and 1518b TCP TPUT tests to Denverton.
 + Its x553 NIC is not affected.
 + That gives us some comparison on how packet size affects performance.

Ticket: CSIT-1830

Change-Id: I5544f7ba84d4813148bcad2f9d64634939492647
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agofeat(tests): Remove PPS tests. 42/36342/3
Vratko Polak [Wed, 8 Jun 2022 08:39:49 +0000 (10:39 +0200)]
feat(tests): Remove PPS tests.

+ Delete nat44 pps suites.
+ Rename ip4base suites, testcases, suite tags (also tg) to -tput.
 + Also robot tags like UDP_PPS and TCP_PPS.
- Keep traffic types and traffic profile names with pps.
 + They can be renamed in a different change if needed.
+ Update job specs.
- Do not update methodology yet (avoid conflict with another Change).

Ticket: CSIT-1829

Change-Id: Ic0dac441f6e8253edce88e057ab7fad1d3814c24
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agoFeat(uti): Last failed tests 35/36435/3
Tibor Frank [Tue, 14 Jun 2022 12:31:17 +0000 (14:31 +0200)]
Feat(uti): Last failed tests

Change-Id: Ifac36b3f2c886a78cb8a7922f98a760287d631ef
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofeat(infra): SnowRidge docs 60/36160/4
Peter Mikus [Wed, 18 May 2022 09:57:02 +0000 (11:57 +0200)]
feat(infra): SnowRidge docs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie53e1e7474542547d73bdfe2a234e6e838bdd454

22 months agofix(vlan): do not apply strip offload 76/36376/3
Vratko Polak [Thu, 9 Jun 2022 11:13:22 +0000 (13:13 +0200)]
fix(vlan): do not apply strip offload

Some tests (bonding) are failing as VPP refuses startup.conf.
That is because the config parameter support has been removed:
https://gerrit.fd.io/r/c/vpp/+/34822
That is VPP commit 8c8531c15c9195c2c82695eff6e70887de67fd88.

According to commit message, it was just a workaround
for Cisco ENIC cards, which are no longer tested in CSIT.

+ Delete 1 robot and 1 python keyword as they become unused.

Change-Id: If53e324a27cfbd4659e49ab8bcd03253642dde96
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agofix(stl_traffic): track both ports on unidir 25/36425/4
Vratko Polak [Mon, 13 Jun 2022 12:44:15 +0000 (14:44 +0200)]
fix(stl_traffic): track both ports on unidir

Even if the suite asks for unidirectional stateless traffic,
in some circumstances (e.g. reconf tests)
stats from both ports are needed to determine overall loss.
Enabling both ports unconditionally fixes that
without any negative consequences.

Latency info is still gathered only for one direction in unidir tests.

Change-Id: Ifec6603d6103c9981fc0af02a81b0db215ccb77c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agodoc(report): Update test environment 34/36434/1
Peter Mikus [Tue, 14 Jun 2022 11:14:49 +0000 (11:14 +0000)]
doc(report): Update test environment

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I9987cac1493ea75eb097a0f2123768eec1ca3d73

22 months agofix(infra): Topopology link swap 33/36433/2
Peter Mikus [Tue, 14 Jun 2022 09:53:03 +0000 (09:53 +0000)]
fix(infra): Topopology link swap

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I20fc441cb46b70b2c315a2c865c3d11e3c341212

22 months agofix(pylint): Some quick pylints 28/36428/2
Peter Mikus [Tue, 14 Jun 2022 06:34:55 +0000 (06:34 +0000)]
fix(pylint): Some quick pylints

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iba133914882485191ad962e36fae70b6fda0af98

22 months agotrending: fix 3n-alt missing in dashboard 30/36430/1
Viliam Luc [Tue, 14 Jun 2022 08:30:17 +0000 (10:30 +0200)]
trending: fix 3n-alt missing in dashboard

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: I356998c521d47f085a78bf2577574ea0d489e02d

22 months agofeat(uti): remove not neccessary data 26/36426/2
Tibor Frank [Mon, 13 Jun 2022 13:07:47 +0000 (15:07 +0200)]
feat(uti): remove not neccessary data

Change-Id: I10f00fce9623ec1dfe34925087e2669ae411e036
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofeat(dpdk): Bump the version within VM 24/36424/2
Peter Mikus [Mon, 13 Jun 2022 08:16:04 +0000 (08:16 +0000)]
feat(dpdk): Bump the version within VM

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Ie358593f9977d04aca9e50a14e0d14158e1b0cf1

22 months agodoc(infra): Fix firmware versions 23/36423/2
Peter Mikus [Mon, 13 Jun 2022 05:57:02 +0000 (05:57 +0000)]
doc(infra): Fix firmware versions

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I755043bc10b2bc419daf007f023742e814c3c63b

22 months agoUpdate VPP_STABLE_VER files 00/36400/2
Tibor Frank [Mon, 13 Jun 2022 04:23:57 +0000 (04:23 +0000)]
Update VPP_STABLE_VER files

Change-Id: I918daab67aa4a4495b9080f7e0e87b9aa950d2b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofix(hoststack): distinguish two tcp tag types 21/36421/4
Vratko Polak [Fri, 10 Jun 2022 14:01:22 +0000 (16:01 +0200)]
fix(hoststack): distinguish two tcp tag types

Previous change did not consider TCP_PPS and TCP_CPS robot tags
are used by two different suite types (hoststack or ASTF).
This fixes the unintended impact on hoststack.

+ Add HOSTSTACK tag to VSAP suites.
 - They could also get VSAP tag, but not needed for this Change.

Fixes: 1daa6fdc0bae284dee1b61f34534e59b60b7526a

Change-Id: Ic583b5ae336c9b74794706fefc232f221a243c87
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agofix(core): T-Rex initialization 54/36354/2
Peter Mikus [Thu, 9 Jun 2022 09:45:26 +0000 (09:45 +0000)]
fix(core): T-Rex initialization

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I53226ff6a345ac99c1e2e110712b2ff6197efe95

22 months agofeat(uti): statistical graphs 20/36420/3
Tibor Frank [Fri, 10 Jun 2022 11:13:08 +0000 (13:13 +0200)]
feat(uti): statistical graphs

Change-Id: Ic05d56dae08e9745582e02e59e8b76145050ca73
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofix(wireguard): add missing test teardown 19/36419/1
Vratko Polak [Fri, 10 Jun 2022 08:10:15 +0000 (10:10 +0200)]
fix(wireguard): add missing test teardown

Fixes: 75ef277536c43096e7646430568d97d2cc489238

Change-Id: I94575bee0aa77907cc900b58b186c3612fb18d85
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
22 months agofeat(uti): Add statistical graphs 72/36172/10
Tibor Frank [Thu, 19 May 2022 12:24:15 +0000 (14:24 +0200)]
feat(uti): Add statistical graphs

Change-Id: Ia2831cfbcb9e2333c5b49af5c6b0577867d99902
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add retest data 53/36353/1
Tibor Frank [Thu, 9 Jun 2022 09:43:11 +0000 (11:43 +0200)]
Report: Add retest data

Change-Id: Ic42a15b44e0395c194cdeddef6d91635fd0f9b10
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoAdd Test Suite for VPP WireGuard 69/36169/6
Cui,Cheng [Thu, 19 May 2022 06:48:04 +0000 (06:48 +0000)]
Add Test Suite for VPP WireGuard

Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
Change-Id: I71e257e5f16a887a40ff83d782a9ebdee9d05c34
Signed-off-by: Cui,Cheng <cheng.cui@intel.com>
22 months agofix(infra): 2n-clx links and docs 50/36350/2
Peter Mikus [Wed, 8 Jun 2022 12:35:04 +0000 (12:35 +0000)]
fix(infra): 2n-clx links and docs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: Iac1743da3eb51c69c67e8496ad4145dcc616341c

22 months agoReport: Add dpdk and re-test data 46/36346/1
Tibor Frank [Wed, 8 Jun 2022 08:49:08 +0000 (10:49 +0200)]
Report: Add dpdk and re-test data

Change-Id: Ia078a30f467c9a0eac45a58b83dd82975b815b5a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofix(infra): Temporarily disable X710 link loop 41/36341/1
Peter Mikus [Tue, 7 Jun 2022 08:20:45 +0000 (10:20 +0200)]
fix(infra): Temporarily disable X710 link loop

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4a8eb282754a5689cd538653e34bbc456e198f94

22 months agoReport: Add rc1, re-test, dpdk data 40/36340/1
Tibor Frank [Tue, 7 Jun 2022 05:29:50 +0000 (07:29 +0200)]
Report: Add rc1, re-test, dpdk data

Change-Id: I1ae47ee5d0ae21dd17bd6e99d81ab5e8f223f70b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add rc1, dpdk, re-test data 37/36337/1
Tibor Frank [Mon, 6 Jun 2022 07:56:17 +0000 (09:56 +0200)]
Report: Add rc1, dpdk, re-test  data

Change-Id: Icb8c2acccd27a7d2ec0da2b524a743f795f7ab36
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoUpdate VPP_STABLE_VER files 94/36294/2
Tibor Frank [Mon, 6 Jun 2022 04:49:56 +0000 (04:49 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ib6b2e0121b57aeba48baf1fcb7dacf5c07f05da1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add rc1 data 29/36329/1
Tibor Frank [Fri, 3 Jun 2022 04:45:02 +0000 (06:45 +0200)]
Report: Add rc1 data

Change-Id: I569e49967bdebb02828cd166f7a9164afbbe9205
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add 3n-alt latency graphs 24/36324/2
Tibor Frank [Thu, 2 Jun 2022 09:55:48 +0000 (11:55 +0200)]
Report: Add 3n-alt latency graphs

Change-Id: Iaf2d123bcfd594d3e35d07c981c9f4b0597c7929
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add rc1 data 23/36323/1
Tibor Frank [Thu, 2 Jun 2022 06:19:54 +0000 (08:19 +0200)]
Report: Add rc1 data

Change-Id: I06c976cb91d5125d18fc9b2d313c2373f61d88b1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: fix: 3n-alt 20/36320/1
Tibor Frank [Wed, 1 Jun 2022 18:38:40 +0000 (20:38 +0200)]
Report: fix: 3n-alt

Change-Id: Idf3d8a393b928cf6f939355d2f6a5af93d18f440
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add 3n-alt rc1 data 19/36319/2
Tibor Frank [Wed, 1 Jun 2022 18:22:08 +0000 (20:22 +0200)]
Report: Add 3n-alt rc1 data

Change-Id: I176dd4a109056b01c2b1b3b11e274b57258b7a02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add 3n-alt 14/36314/2
Tibor Frank [Wed, 1 Jun 2022 13:40:43 +0000 (15:40 +0200)]
Report: Add 3n-alt

Change-Id: I2a811d5a2e618dc339a3e40c3b8c374a5051649c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Remove 3n-aws 12/36312/1
Tibor Frank [Wed, 1 Jun 2022 07:38:04 +0000 (09:38 +0200)]
Report: Remove 3n-aws

Change-Id: I6e065cf25536197c2e414fde017390d54fb3b15c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add rc1 data 11/36311/2
Tibor Frank [Wed, 1 Jun 2022 07:16:15 +0000 (09:16 +0200)]
Report: Add rc1 data

Change-Id: I79678b56fcdc5c8ff8736a87a7437ee145a40459
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofix(core): TG export 10/36310/1
Peter Mikus [Wed, 1 Jun 2022 05:22:19 +0000 (07:22 +0200)]
fix(core): TG export

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I80f9f32f10d46eccf1157949a184ec4467d071cd

22 months agofix(etl): Typo 04/36304/1
Peter Mikus [Tue, 31 May 2022 10:48:56 +0000 (12:48 +0200)]
fix(etl): Typo

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I4deed6b4c64cf9c04547d2a7cc0319bfa8aee1b6

22 months agoFramework: exclude env and .git when copying 55/35655/6
Juraj Linkeš [Wed, 16 Mar 2022 08:46:15 +0000 (09:46 +0100)]
Framework: exclude env and .git when copying

The tarball is unnecessarily big, remove superflous directories.

Change-Id: I55f6fae64973cfac34a1dc18cbdc688cd416e8b9
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
22 months agoReport: Add rc1 data 03/36303/1
Tibor Frank [Tue, 31 May 2022 04:47:49 +0000 (06:47 +0200)]
Report: Add rc1 data

Change-Id: I4f83a043c65ac1c968020024d139123a836fb33b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoPAL: Remove nexus from data sources 98/36298/1
Tibor Frank [Mon, 30 May 2022 13:51:30 +0000 (15:51 +0200)]
PAL: Remove nexus from data sources

Change-Id: Iec40f3cb1ca543dc42017ccfb2a663aee1204531
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agoReport: Add rc1 data 97/36297/2
Tibor Frank [Mon, 30 May 2022 12:52:21 +0000 (14:52 +0200)]
Report: Add rc1 data

Change-Id: If71ad64c0778793afd9b8d8aff8a55c035b7dbfe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
22 months agofeat(infra): Update AWS AMIs 55/36255/2
Peter Mikus [Mon, 30 May 2022 10:01:22 +0000 (12:01 +0200)]
feat(infra): Update AWS AMIs

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I1fd9351b2c3448809bdef282c23eedd1ca3364a7

22 months agotrending: tput 100b tests update + static content 15/36215/4
Viliam Luc [Thu, 26 May 2022 06:57:45 +0000 (08:57 +0200)]
trending: tput 100b tests update + static content

Signed-off-by: Viliam Luc <vluc@cisco.com>
Change-Id: Iba05311055b901ca3f5c2714bf0ea1c87525af50

22 months agofeat(docs): Add e810 for 2n-clx 54/36254/3
Peter Mikus [Mon, 30 May 2022 08:06:17 +0000 (10:06 +0200)]
feat(docs): Add e810 for 2n-clx

Signed-off-by: Peter Mikus <pmikus@cisco.com>
Change-Id: I607ccd5d4b28dca576e40b79285bb2b31a65d76c