csit.git
2 years agoMethodology: Update MLRsearch descriptions 90/33290/1
Vratko Polak [Wed, 4 Aug 2021 08:26:28 +0000 (10:26 +0200)]
Methodology: Update MLRsearch descriptions

Change-Id: Icdcb7210835fa90a6f5f1688b815a6edf07a4b39
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit ad8442c642f5dd4a6630e1e66c980cb86c5039bb)

2 years agoTrending: Add Latency trending 87/33287/1
Tibor Frank [Tue, 27 Jul 2021 13:02:37 +0000 (15:02 +0200)]
Trending: Add Latency trending

Change-Id: I28c1f1cf113d2537f3e564cdca0fd61ef57737a9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 2e021b4853ced07e820a933ca9062d9c325a8a7f)

2 years agoReport: configure rls2106.31 86/33286/1
Tibor Frank [Wed, 4 Aug 2021 07:29:01 +0000 (09:29 +0200)]
Report: configure rls2106.31

Change-Id: I9d5da2d71525b53096e9c77e9d338243b16f05c1
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 913ddff5d85c822b8eb974def458a5022246ef53)

2 years agoFIX: init interfaces for rdma-core driver 85/33285/1
Juraj Linkeš [Fri, 30 Jul 2021 08:11:12 +0000 (10:11 +0200)]
FIX: init interfaces for rdma-core driver

We're only initializing interfaces for avf and af_xdp VPP drivers. This
causes issues for the rdma-core driver when the underlying mlnx kernel
driver is not bound. Fix this so that all interfaces are properly bound
to the kernel driver required by rdma-core.

Change-Id: I204309a9bb61b56b96497a287178f0b1efe2f362
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit 324f01417f17a5347c102179f3d2277a77b116ce)

2 years agoRCA: Add CSIT-1789 as a known issue 81/33281/2
Vratko Polak [Wed, 28 Jul 2021 08:44:23 +0000 (10:44 +0200)]
RCA: Add CSIT-1789 as a known issue

Change-Id: Ia01eddc69f64d7f4360cda7a612b5b8fae2c41b4
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 68f32506b32feddae4f9674a7a32cd3d0ea61fb7)

2 years agoReport: latency comparison 83/33283/1
Tibor Frank [Tue, 3 Aug 2021 09:03:14 +0000 (11:03 +0200)]
Report: latency comparison

Change-Id: Ic47209e1911317b6f42a7f8257309607d3a21e04
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c9ddd355f7cab79d6a3f337a658f7c377e099661)

2 years agoReport: Configure 2106.31, fix latency 82/33282/1
Tibor Frank [Tue, 3 Aug 2021 05:40:23 +0000 (07:40 +0200)]
Report: Configure 2106.31, fix latency

Change-Id: I6f9e3cc3b79be84acb6b5619016a9aa7d4296e02
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7902281ee08456a4d90bb5829ba42da2c71a6379)

2 years agoReport: Add Latency comparison tables 80/33280/1
Tibor Frank [Mon, 2 Aug 2021 12:31:37 +0000 (14:31 +0200)]
Report: Add Latency comparison tables

Change-Id: I6774383eef9839352ed3924e7482177fd85b34e6
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f615617a46a21107a9a827a13035997e91bf6d3f)

2 years agoPAL: Add s3-logs 78/33278/1
pmikus [Mon, 19 Jul 2021 06:53:00 +0000 (06:53 +0000)]
PAL: Add s3-logs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ia8cc2c59a84a61263b2cf88af16f6fd7bad637a8
(cherry picked from commit d102788108352fd5271b139ef3ef1a1c718389a1)

2 years agoCSIT-1782: 4c AVF tests are failing 77/33277/1
pmikus [Tue, 27 Jul 2021 07:24:04 +0000 (07:24 +0000)]
CSIT-1782: 4c AVF tests are failing

+ Implement temporary ugly workaround as I cannot do
  driver upgrade now after discussions with PTL.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I400e3b61bd831b9c9820b1fab8852118f2d48f0e
(cherry picked from commit 9e86d195050fcd75c20d59f78d6f5a5e379a6a86)

2 years agoReport: Add rls data 76/33276/1
Tibor Frank [Wed, 28 Jul 2021 06:42:47 +0000 (08:42 +0200)]
Report: Add rls data

Change-Id: I2ad71d35bb2503adbe10cf3e7982e883339a4fee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit cf63723c2758fb5561bd1810a2725b1e187f9c1f)

2 years agoFIX: Executable bit for ansible plugin 15/33215/1
pmikus [Tue, 27 Jul 2021 10:11:21 +0000 (10:11 +0000)]
FIX: Executable bit for ansible plugin

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2416a9682710441d098acfff50e943ac3f788500
(cherry picked from commit f7c3f3918646a7bb157e648ed96beb9bb5c232ea)

2 years agoReport: Add rls data 14/33214/1
Tibor Frank [Tue, 27 Jul 2021 08:54:40 +0000 (10:54 +0200)]
Report: Add rls data

Change-Id: Ia101a6d412473d957a81d794f34f1c1d2ad58abb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 0d9bed4128719f3de748af108dc6259927efde29)

2 years agoInfra: Terraform add ansible plugin init 13/33213/2
pmikus [Mon, 26 Jul 2021 12:54:58 +0000 (12:54 +0000)]
Infra: Terraform add ansible plugin init

+ Manual override

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If296d28dc3eaa023c935a0887a14ac10e83076ba
(cherry picked from commit b27f2c7cbfe08712a00959c8cc6a2f618a25b3e7)

2 years agoTrending: Save latency data in csv files 11/33211/1
Tibor Frank [Tue, 20 Jul 2021 08:19:09 +0000 (10:19 +0200)]
Trending: Save latency data in csv files

Change-Id: I397dc1711f52324c158c775522cfef3044724ad7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a4fe771848907ee4a551cf06432f1ec6da496608)

2 years agoReport: configure rls2106.30 10/33210/1
Tibor Frank [Mon, 26 Jul 2021 12:32:13 +0000 (14:32 +0200)]
Report: configure rls2106.30

Change-Id: If1af4d7c5865a7466eda5c2de18d07ff9491d458
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 53e6c3440afd81d1504db75e7fa8d09229641079)

2 years agoReport: Add af-xdp data 09/33209/1
Tibor Frank [Fri, 23 Jul 2021 09:49:17 +0000 (11:49 +0200)]
Report: Add af-xdp data

Change-Id: I8beef5f0072e0c52476a8053f26640c537422a63
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e8b47c3df7529a6c087fb7639684f180dad8c03d)

2 years agoTrending: Add exception handling for anomalies classification 07/33207/1
Tibor Frank [Fri, 23 Jul 2021 09:05:04 +0000 (11:05 +0200)]
Trending: Add exception handling for anomalies classification

Change-Id: I6f2ee7552c513ccf2fa453f143dd52ea880bd412
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1da19da813655f643bc3c6e4d03bed987f076f07)

2 years agoReport: Add rls data 06/33206/1
Tibor Frank [Wed, 21 Jul 2021 06:12:33 +0000 (08:12 +0200)]
Report: Add rls data

Change-Id: Id234d16ebbca84b663f23d295accddaf8c045417
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a8d0c4410095c6b87f81bd541ca7ec91e6d62b70)

2 years agoReport: Add af-xdp 05/33205/1
Tibor Frank [Wed, 21 Jul 2021 13:13:42 +0000 (15:13 +0200)]
Report: Add af-xdp

- elements(tput, speed-up)
- static content (tput, speedup)
- data
- Latency

Change-Id: I793fd4e6e6b189d93a267635b8bf07baad19accd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c5b94383d2eb8ea33413296a3295759b84915546)

2 years agoReport: IPsec udir methodology 04/33204/1
Juraj Linkeš [Thu, 15 Jul 2021 09:27:03 +0000 (11:27 +0200)]
Report: IPsec udir methodology

Update IPsec uni-directional tests methodology.
Remove Deep SPD Policy section as these tests are not in the report.

Change-Id: Idca538a03a05e12130c7d786c098b218fa88f7ef
Signed-off-by: Juraj Linkeš <juraj.linkes@pantheon.tech>
(cherry picked from commit dea4d7ff2a1b662cde1587b3a8d6c3d832f4920e)

2 years agoTrending: Add graph with statistics 03/33203/1
Tibor Frank [Tue, 13 Jul 2021 06:47:31 +0000 (08:47 +0200)]
Trending: Add graph with statistics

- x-axis: time [MM-DD]
- y-axis: nr of passed/failed tests
- y-axis: build duration

Change-Id: I269af5a728a32d02ffcdecc7e25138ad1a183c4b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit d8fc1521b8def68adc8f4a390aa2d25db806ea4f)

2 years agoPerf: Enable af_xdp for Intel x500 series 02/33202/1
pmikus [Wed, 21 Jul 2021 13:43:32 +0000 (13:43 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If45e592aeade12fe643791b431adc860a745be3d
(cherry picked from commit fe9072ce82a91c5d6de30d07756d5a12b80f9c74)

2 years agoPerf: Enable af_xdp for Intel x500 series 01/33201/1
pmikus [Wed, 21 Jul 2021 12:17:21 +0000 (12:17 +0000)]
Perf: Enable af_xdp for Intel x500 series

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I331fe9134c62594189ca231349ab4c5ba43b51e5
(cherry picked from commit 813375246758d1695be4e577ba9cd3f0791ea9e3)

2 years agojob_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs 00/33200/1
Maciek Konstantynowicz [Tue, 20 Jul 2021 16:08:22 +0000 (17:08 +0100)]
job_specs: 2n-tx2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node ThunderX2 testbeds.
- NICs covered: xl710.

Change-Id: Ibff19986168a2da87398709b8ec19b4b1f777fe7
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 44a77d78e272d95e055b6d596c122f4825a9072a)

2 years agojob_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs 99/33199/1
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:38:32 +0000 (16:38 +0100)]
job_specs: 2n-skx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Skylake testbeds.
- NICs covered: x710, xxv710.

Change-Id: I7747b5680cef05dad92788652c55f180fd93a5d1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f5ba2f7100d73e009252782492fef289f2fc4947)

2 years agojob_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs 98/33198/1
Maciek Konstantynowicz [Tue, 20 Jul 2021 15:51:16 +0000 (16:51 +0100)]
job_specs: 2n-zn2 add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Zen2 testbeds.
- NICs covered: x710, xxv710.

Change-Id: Ie5cd2374dd81bc2fa59400bb8af91dcbf6efb9bf
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit b9ad36b5f2090a60177d8e38a091dacb7a00e953)

2 years agoFIX: Testbed driver and firmware versions 97/33197/1
pmikus [Wed, 21 Jul 2021 06:20:26 +0000 (06:20 +0000)]
FIX: Testbed driver and firmware versions

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I2bb08a3cd7f2138ab98b3c4dacdd1dc46ac8b523
(cherry picked from commit 9479510935a273730ace23481f19706cefbce437)

2 years agoFIX: Mellanox 15/33115/1
pmikus [Tue, 20 Jul 2021 07:04:31 +0000 (07:04 +0000)]
FIX: Mellanox

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I6aba0123c1f79e5c2acbac07503f74fc0050f472
(cherry picked from commit 3725984899ab67d69ad89e5f79d3334ba2fdc780)

2 years agojob-spec: Fix af-xdp mlr iterative job spec 13/33113/1
Tibor Frank [Mon, 19 Jul 2021 07:18:39 +0000 (09:18 +0200)]
job-spec: Fix af-xdp mlr iterative job spec

Change-Id: I012d504309eea97edac7f11bd22935bb8325f988
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f71dd880aa5f5cd2ffc5bab83bd9307b17a6af6c)

2 years agoReport: Add rls data 12/33112/1
Tibor Frank [Fri, 16 Jul 2021 06:21:20 +0000 (08:21 +0200)]
Report: Add rls data

Change-Id: I9c81563c904b02c5ca6ede5dc3d0922851c11ae4
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 39957a024d1fff87403aacc34aaaa5a922b6639f)

2 years agojob_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs 11/33111/1
Maciek Konstantynowicz [Fri, 16 Jul 2021 12:09:56 +0000 (13:09 +0100)]
job_specs: 2n-clx add af_xdp tests to report_iterative, daily and weekly jobs

- Testbeds covered: 2-node Cascadelake testbeds only.
- NICs covered: x710, xxv710 only.

Change-Id: I3548990a27e5a47b1749bf235da526b3fe2b4353
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 5576796f38aeab2016ed6a01a859f2df6737677c)

2 years agoReport: Remove missing latency graphs 10/33110/1
Tibor Frank [Thu, 15 Jul 2021 11:20:46 +0000 (13:20 +0200)]
Report: Remove missing latency graphs

- they were not generated as the tests failed
- Fixed legend in dpdk comparison tables

Change-Id: Idd57c1702c883d4f6ece470310e823f5885a9bce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8c4e9c508d9bf53eb5c6cc8bc531215825c800e1)

2 years agoReport: Configure rls2106.29, add data 09/33109/1
Tibor Frank [Thu, 15 Jul 2021 07:52:14 +0000 (09:52 +0200)]
Report: Configure rls2106.29, add data

Change-Id: Ib51ee05d67a5a6506367b9f194441be50f360d38
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 149b1109affae3e54157e3c38db97f376d27328b)

2 years agoReport: Add rls data 08/33108/1
Tibor Frank [Wed, 14 Jul 2021 12:40:02 +0000 (14:40 +0200)]
Report: Add rls data

Change-Id: I013515f98c3aaa4b347d61dd2c815f2ac67d56f0
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 8a1e62de051d4952b7e4e3e42f103f3f068d1a6c)

2 years agoReport: Add per thread resources allocation methodology 07/33107/1
pmikus [Mon, 12 Jul 2021 14:47:17 +0000 (14:47 +0000)]
Report: Add per thread resources allocation methodology

Per thread resources include:
- pcores and lcores.
- RxQs.
- TxQs.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I64b418a99673bf05b37a9e97be4aaa80e4ffb835
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 8cd8790583b4d56985c486489327c92e6a9464a0)

2 years agoreport: update to rls notes and add methodology sections TODO placeholders 06/33106/1
Maciek Konstantynowicz [Wed, 14 Jul 2021 10:35:35 +0000 (11:35 +0100)]
report: update to rls notes and add methodology sections TODO placeholders

- Update VPP and DPDK rls notes.
- Added methodology sections TODO placeholders
  - IPsec with Async Crypto Feature Workers
  - IPsec Uni-Directional Tests
  - IPsec Deep SPD Policy Tests
  - GTPU Tunnels

Change-Id: Ibfb937f193cce3a6576ac64cf00ad2e1b4bc3868
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit d9bb63c2d9f126800f69bd53fca5d42fd2beb739)

2 years agoReport: Add data, set archiving and pdf version 05/33105/1
Tibor Frank [Wed, 14 Jul 2021 09:46:16 +0000 (11:46 +0200)]
Report: Add data, set archiving and pdf version

Change-Id: Iaa1ef8bd12f536723d6894fbf86acfe280929ade
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit da7ec9bf7aff31d18325043891aa19cda2b063ec)

2 years agoReport: Add rls data 03/33103/1
Tibor Frank [Wed, 14 Jul 2021 07:55:40 +0000 (09:55 +0200)]
Report: Add rls data

Change-Id: I6a133fd2fe99ec851d2eb0c5b5cc52a5169522c3
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a47cc2dbd97aee82deebec9bd750d661aaca6942)

2 years agoReport: Fix links to graphs in hoststack section 02/33102/1
Tibor Frank [Tue, 13 Jul 2021 07:19:41 +0000 (09:19 +0200)]
Report: Fix links to graphs in hoststack section

Change-Id: If75297ecb4c55b2a1c40dffbe354d77c537e905f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a841b190f7e448e8c30883e43eb3e6bcecc7788a)

2 years agoReport: Add rls data 01/33101/1
Tibor Frank [Tue, 13 Jul 2021 07:10:22 +0000 (09:10 +0200)]
Report: Add rls data

Change-Id: I0167c72751aa5deae576335bbf91f62557ea8526
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ec79cd31fd974372fd6cd02be6a504dff6d50e8e)

2 years agoHoststack report content 00/33100/1
Dave Wallace [Mon, 28 Jun 2021 21:36:30 +0000 (17:36 -0400)]
Hoststack report content

- Methodology section
- Align dynamic content structure with methodology section

Signed-off-by: Dave Wallace <dwallacelf@gmail.com>
Change-Id: I852c0f8147947dd8418de5fc2fdbd16a1c1e2057
(cherry picked from commit c77930b44bd1a35786a4b843bb75a9cbc8741b4b)

2 years agojob-spec: Add hoststack and vsap 99/33099/1
Tibor Frank [Tue, 15 Jun 2021 08:34:51 +0000 (10:34 +0200)]
job-spec: Add hoststack and vsap

+ hoststack
+ vsap (cps, rps)
+ add e810cq to common.sh

Change-Id: I2e897597d13e488f7324a7b91826ca32fd93c84f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e77fa027ad2a541e53d92743d8477d3aecf944e2)

2 years agoreport: add 2n-icx and 3n-icx testbed documentation 98/33098/1
Maciek Konstantynowicz [Thu, 8 Jul 2021 14:47:53 +0000 (15:47 +0100)]
report: add 2n-icx and 3n-icx testbed documentation

Add:
- Physical testbeds description in Introduction.
  - Add physical topology diagrams.
- VPP pre-release 21.06 version used in Intel labs for CSIT tests.

Change-Id: I3c17402de8c657f66ea840c9d8692212cbf0501a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit f85930d7b1e3cda191a2e60cbc4e64d93c5fd139)

2 years agoReport: Add rls data 55/33055/1
Tibor Frank [Mon, 12 Jul 2021 08:58:32 +0000 (10:58 +0200)]
Report: Add rls data

Change-Id: Id69117a538294622a9c24efc9fb41aa70d61fedd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7692bfcfbe9d93a24a3840472fbaccabbefe747c)

2 years agoReport: Add rls data 52/33052/1
Tibor Frank [Fri, 9 Jul 2021 07:01:16 +0000 (09:01 +0200)]
Report: Add rls data

Change-Id: I950a9b3ba9066d1552649cbd4031a2ba1cf14ccd
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7ebf93a4ed4f046f3685db87165a75772aa0557e)

2 years agoPAL: Process sh run from telemetry 51/33051/1
Tibor Frank [Wed, 7 Jul 2021 09:52:02 +0000 (11:52 +0200)]
PAL: Process sh run from telemetry

Change-Id: I62ef60362f2921122c2f71e4f90c10cdc7185e1f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 9789d21f6be4959e9eecc870cf46478960957463)

2 years agojob_specs: 3n-tsh reduce number of report coverage tests 50/33050/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 16:27:24 +0000 (17:27 +0100)]
job_specs: 3n-tsh reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: Ib359c08366768f362c70c184707ab9fde46e1930
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 43f0eca4e9581f26180dfee360554157b56e484f)

2 years agojob_specs: 3n-dnv reduce number of report coverage tests 49/33049/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:26:41 +0000 (14:26 +0100)]
job_specs: 3n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Icd9aa0b0807b16efc26fc94d6633ab61a6c47d9a
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 7a551264705ea0d069fe18345c90d89b44a59def)

2 years agojob_specs: 2n-zn2 reduce number of report coverage tests 48/33048/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 13:16:40 +0000 (14:16 +0100)]
job_specs: 2n-zn2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia67492b2fd132a64f05a1e8de4cfc136a015fef3
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 58edde117f1c2bd758cb77a6b19fb1e275bcbfe6)

2 years agojob_specs: 3n-skx reduce number of report coverage tests 47/33047/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 15:00:05 +0000 (16:00 +0100)]
job_specs: 3n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- -100flows, -100kflows in all acl tests.

Change-Id: I3525987726c347be5ffca03dbb82c2b1cf675c2b
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e9786cb012939d822ef1fc5c59e4763fc8cbee42)

2 years agojob_specs: 2n-tx2 reduce number of report coverage tests 46/33046/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 12:05:00 +0000 (13:05 +0100)]
job_specs: 2n-tx2 reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Ia2187fa0ba9c8836840aa2fb7d0c335a3b0d91b1
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 2d994d6853ecf9675152a725333ce7e52eb6ad3a)

2 years agojob_specs: 2n-skx reduce number of report coverage tests 45/33045/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 11:45:21 +0000 (12:45 +0100)]
job_specs: 2n-skx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: Iae8612bd09980350b0cf5eb90ea4833296c73fc8
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 9182f99fe55e8009836c77df11cb3e3b58fefacc)

2 years agojob_specs: 2n-dnv reduce number of report coverage tests 44/33044/1
Maciek Konstantynowicz [Wed, 7 Jul 2021 10:59:16 +0000 (11:59 +0100)]
job_specs: 2n-dnv reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.

Change-Id: Ifb7d256ea0ff4afe18f80baf1e9058d3775e85d4
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit cd3392cf61fd23b333581dc111fe040fd72de77f)

2 years agojob_specs: reduce number of report coverage tests for ipsec 43/33043/1
Maciek Konstantynowicz [Mon, 14 Jun 2021 13:12:00 +0000 (15:12 +0200)]
job_specs: reduce number of report coverage tests for ipsec

Remove:
- ipsec tests
  - ethip4ipsectptlispgpe.
  - policy-aes128gcm.
  - policy-aes128cbc-hmac256sha.
  - policy-aes128cbc-hmac512sha.
  - int-aes128cbc-hmac256sha.
  - scale of
    - 400tnlsw.
    - 5000tnlsw.
    - 20000tnlsw.
    - 60000tnlsw.

Change-Id: I1443f35b7bf852fd665e8856d05bf04b9827913f
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit e75e2f7a9b2fa73718f8a4a5a31fbe56b234f820)

2 years agoReport: Add rls data 42/33042/1
Tibor Frank [Thu, 8 Jul 2021 06:52:16 +0000 (08:52 +0200)]
Report: Add rls data

Change-Id: I336d3d291be38dbc6483386945e0edcdca4a9fae
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 26f1ebf5e85d569018e0a4a1ac188ae59b78b833)

2 years agoReport: Add rls data 41/33041/1
Tibor Frank [Wed, 7 Jul 2021 11:59:35 +0000 (13:59 +0200)]
Report: Add rls data

Change-Id: I82522a17b1b3b919adc6de28772d4323c57b0b2c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 3c88629c05256b8f5b1e435a8e94d488eb769224)

2 years agojob_specs: 2n-clx reduce number of report coverage tests 40/33040/1
Maciek Konstantynowicz [Wed, 26 May 2021 13:46:14 +0000 (14:46 +0100)]
job_specs: 2n-clx reduce number of report coverage tests

Remove:
- All vts tests, obsolete use cases.
- dot1q tests apart from dot1q-l2bd, superfluous combinations.
- nat44 -pps tests, replaced by -tput tests.
- nat44 h1-p1-s1 single session tests, unessential combination.
- nat44 h4096-p63-s258048 tests, non-essential scale combination.

Change-Id: I2e2ff96dd727977f55e38f7a388f1afe68096aa9
Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
(cherry picked from commit 88dd453ccd24b70752c7498b81101a97fc777043)

2 years agoReport: Publish icx results 38/33038/1
Tibor Frank [Tue, 6 Jul 2021 12:36:07 +0000 (14:36 +0200)]
Report: Publish icx results

Change-Id: Iea22c61f97e62743b4a99b961290a7f722496162
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5af912d1cebf5545c6f7de2bba75d51d828b4554)

2 years agoReport: Add rls data 37/33037/1
Tibor Frank [Wed, 7 Jul 2021 07:29:37 +0000 (09:29 +0200)]
Report: Add rls data

Change-Id: I47f36db2b42c3d12c3173fc336fead94fe626abe
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit a4a74d3a84fff025fcd0fc630a068bd1cac076dc)

2 years agoTelemetry: Add node info 36/33036/1
pmikus [Tue, 6 Jul 2021 12:31:26 +0000 (12:31 +0000)]
Telemetry: Add node info

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I428bf2628f5d6b87d335de415a82d6e94867d8c0
(cherry picked from commit 9b7a1a0ad6dda662fa82dedbeeaf71f7ac625e31)

2 years agoDocs: DPDK release notes 95/32995/1
pmikus [Tue, 6 Jul 2021 10:47:26 +0000 (10:47 +0000)]
Docs: DPDK release notes

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie7c009d541fbedf7513b7decac9839eb4a98e520
(cherry picked from commit fccc65f1f48d3beb6ce749af4663589fa0484b24)

2 years agoDocs: Update release notes 94/32994/1
pmikus [Tue, 6 Jul 2021 10:35:09 +0000 (10:35 +0000)]
Docs: Update release notes

- Add AVF issue.

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ic0830df665de20466c7bd4ab80b3ea597005b4e1
(cherry picked from commit b059d0c7892e8a54010005949ba365f1a68e856e)

2 years agoReport: Add gtpu tests 76/32976/1
Tibor Frank [Thu, 1 Jul 2021 08:39:33 +0000 (10:39 +0200)]
Report: Add gtpu tests

Change-Id: I0c48f48a927bb75554f0d9eca4f32f0a3dc30d20
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 5f1007cce8831017fd2be1f38a6ad023c349019a)

2 years agoUpdate VPP_STABLE_VER files to RELEASE version 35/32935/2
Tibor Frank [Thu, 1 Jul 2021 05:18:51 +0000 (05:18 +0000)]
Update VPP_STABLE_VER files to RELEASE version

Change-Id: I0946fdb568a04b69c4779535fd5ea53115567496
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Change Throughput to Tput in graphs titles 34/32934/1
Tibor Frank [Wed, 30 Jun 2021 11:44:45 +0000 (13:44 +0200)]
Report: Change Throughput to Tput in graphs titles

Change-Id: Icbd23f4c7339765985f1614debeadf1f4332753a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit c3b989790c6367a74fbccfe7b610a5529fe50193)

2 years agoReport: Implement changes from job-specs 33/32933/1
Tibor Frank [Tue, 29 Jun 2021 11:58:59 +0000 (13:58 +0200)]
Report: Implement changes from job-specs

Change-Id: Id9497ae02eb47fed40b9e4c33b98a81c34b71964
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6c8ba1c706a4e9e467ab5e2a4b676b9016f9e610)

2 years agoReport: Add re-test data 29/32929/1
Tibor Frank [Tue, 29 Jun 2021 05:08:56 +0000 (07:08 +0200)]
Report: Add re-test data

Change-Id: Ifa6bc912d4b0dd5c377ebe1654bff694c0c006e7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit f975cf2f1e2f5baef0ab0da75a53948d025562a2)

2 years agoTrendig: Change the priority of data sources 27/32927/1
Tibor Frank [Mon, 28 Jun 2021 12:15:33 +0000 (14:15 +0200)]
Trendig: Change the priority of data sources

Change-Id: Iee015d717034fd08e86037e5800fbe8231cbd89a
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 336e3689671d0c266e7da035c1df978b2404a86b)

2 years agoReport: Hide re-test data in cmp tbls for tsh, tx2 26/32926/1
Tibor Frank [Mon, 28 Jun 2021 11:56:26 +0000 (13:56 +0200)]
Report: Hide re-test data in cmp tbls for tsh, tx2

Change-Id: I7cf8a819f5fbd84882006ec0ca1891b38b2fb58d
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 578e9a678ebd96789fb63a450336645d6d840afd)

2 years agoReport: Add rc2 data 25/32925/1
Tibor Frank [Mon, 28 Jun 2021 10:30:26 +0000 (12:30 +0200)]
Report: Add rc2 data

Change-Id: I71f1d3957073b5fee66cd38efde003cf19b36396
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1fef0d8079a6a9c2521c7e98a975f4106600410d)

2 years agoPAL: Process sh-run from telemetry 23/32923/1
Tibor Frank [Fri, 25 Jun 2021 11:56:43 +0000 (13:56 +0200)]
PAL: Process sh-run from telemetry

Change-Id: Ia1a3427609b284d0036dfe3b2ffbb17a9b4f8a65
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7b4dc49521908774f9eb2f5d287078cce06d8e49)

2 years agoUpdate VPP_STABLE_VER files 22/32922/2
Tibor Frank [Mon, 28 Jun 2021 04:27:32 +0000 (04:27 +0000)]
Update VPP_STABLE_VER files

Change-Id: I291abcb342fdc113d6baec90fd3bd532176c9ffb
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Fix typo in spec 93/32793/1
Tibor Frank [Wed, 23 Jun 2021 08:42:51 +0000 (08:42 +0000)]
Report: Fix typo in spec

Change-Id: I19ad258be06e30bfb31e9178d646be93ac733cec
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7f5983bd43f65b60a749d7a76a9e4b9d069a1363)

2 years agoReport: Add rc2 data 91/32791/1
Tibor Frank [Wed, 23 Jun 2021 08:26:12 +0000 (10:26 +0200)]
Report: Add rc2 data

Change-Id: Id7fc6305c09cfc32fbeb59f723828443d70b4ab9
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 1e35c39e989399665c36718639f2e1df405e99ec)

2 years agoPAL: Do not read sh run for trending 88/32788/1
Tibor Frank [Tue, 22 Jun 2021 11:49:05 +0000 (13:49 +0200)]
PAL: Do not read sh run for trending

Change-Id: I0e142c1c3bb48ddeb0bcd2bfa11c0323461c1368
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 7c7cad880bb72b19671fec71b3f5d1350995161e)

2 years agoTrending: Remove 3n-hsw from dynamic content 86/32786/1
Tibor Frank [Tue, 22 Jun 2021 11:31:29 +0000 (13:31 +0200)]
Trending: Remove 3n-hsw from dynamic content

Change-Id: I65cfc9a7730d6b154d6085d5f817a7023f994bba
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b3881e8cb219865423bc578c1e65324e15336847)

2 years agoJSON: Implement latest changes 84/32784/1
Tibor Frank [Mon, 21 Jun 2021 14:34:23 +0000 (16:34 +0200)]
JSON: Implement latest changes

Change-Id: Ife5feacad6885427066a5b28978f25965394b557
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 36048e330c53b0325fb120da0f7661ad2dd44611)

2 years agoReport: Add rc2 data 83/32783/1
Tibor Frank [Tue, 22 Jun 2021 07:27:17 +0000 (09:27 +0200)]
Report: Add rc2 data

Change-Id: I24e16127179ebda53cf35260d436332101c79706
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit eb2fad1b89be271b257665d3faeff4d71c453430)

2 years agoReport: Add rc2 data 80/32780/1
Tibor Frank [Mon, 21 Jun 2021 10:29:29 +0000 (12:29 +0200)]
Report: Add rc2 data

Change-Id: I032a897f7724a978b96ec7533f505bedfa0c03d7
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e6f19e85acaba4cb6277b6b2f3ca6aa8ed04f2f8)

2 years agoReport: Add rc2 data 79/32779/1
Tibor Frank [Mon, 21 Jun 2021 10:21:30 +0000 (12:21 +0200)]
Report: Add rc2 data

Change-Id: I177c3237088c5f12288c463a2d6f1b690533079c
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit b99aa38fce149974c7f578710bfb0957a7335878)

2 years agoUpdate VPP_STABLE_VER files 78/32778/2
Tibor Frank [Mon, 21 Jun 2021 05:17:45 +0000 (05:17 +0000)]
Update VPP_STABLE_VER files

Change-Id: I46f7f48fa24c733090d130042582fa114e38f01b
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: Add rc1 data 15/32715/1
Tibor Frank [Thu, 17 Jun 2021 11:22:47 +0000 (13:22 +0200)]
Report: Add rc1 data

Change-Id: Iedc10183e127167fefcfa8369e33b344b20b5d28
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 39c7d3bca8c47bb7bb5ccbaf86ac206786caefb4)

2 years agoUpdate VPP_STABLE_VER files 11/32711/2
Tibor Frank [Thu, 17 Jun 2021 06:16:34 +0000 (06:16 +0000)]
Update VPP_STABLE_VER files

Change-Id: Ie2d82364b35f751ba815497cd89e6ba3c838b83f
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoReport: disable reconf plots 08/32708/1
Tibor Frank [Wed, 16 Jun 2021 10:10:54 +0000 (12:10 +0200)]
Report: disable reconf plots

Change-Id: I983d521142b5725aab43d20a1bf9c8837c0e23af
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit ceeb134057e915d81366fab71e40e23e665bde90)

2 years agoReport: Add vsap 07/32707/1
Tibor Frank [Tue, 15 Jun 2021 12:24:26 +0000 (14:24 +0200)]
Report: Add vsap

Change-Id: I3e8719ab2da0d9b4ae1b24c6b8479724064c8dce
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit bb1a7058e8bbcbe998fdfd8dd5ed46e13fb90db7)

2 years agoReport: Update Infra sections 06/32706/1
pmikus [Tue, 15 Jun 2021 07:57:50 +0000 (07:57 +0000)]
Report: Update Infra sections

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I14aa6f64b2621ad306e1cd79fafefe94dd1ed85a
(cherry picked from commit 2072a56eeca53f00cff1b5d888d24f7271ae1fb4)

2 years agoReport: Add RC1 data 05/32705/1
Tibor Frank [Mon, 14 Jun 2021 11:33:20 +0000 (13:33 +0200)]
Report: Add RC1 data

Change-Id: I8bb69b896438c84cdd280e781697773b8cf91475
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 6726e389d87ebd601a4f4d083833c9f04f573d75)

2 years agoFIX: eval expression 01/32701/1
pmikus [Mon, 14 Jun 2021 08:42:02 +0000 (08:42 +0000)]
FIX: eval expression

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I746a40af0a051978706e7c696d391a051133145f

2 years agoUpdate VPP_STABLE_VER files 99/32699/2
Tibor Frank [Mon, 14 Jun 2021 05:13:33 +0000 (05:13 +0000)]
Update VPP_STABLE_VER files

Change-Id: I369efda427954014db527604519d5d4619cab055
Signed-off-by: Tibor Frank <tifrank@cisco.com>
2 years agoPAL: reduce amount of data 70/32670/1
Tibor Frank [Fri, 11 Jun 2021 08:10:18 +0000 (10:10 +0200)]
PAL: reduce amount of data

Change-Id: If5713c01e73db72e46a863c7499cb437892a2d97
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit 4255e5ea90db6f0c2e4a106ff8cc6dc734ac5422)

2 years agoFIX: GSO tests 69/32669/1
pmikus [Fri, 11 Jun 2021 07:24:46 +0000 (07:24 +0000)]
FIX: GSO tests

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I00372b5528752186a814e83af092e1b0123e4683
(cherry picked from commit b623785eb9ecaf0657e8f6ca6898dabdc5381128)

2 years agoTrenring: Reduce nr of builds to save RAM 67/32667/1
Tibor Frank [Fri, 11 Jun 2021 06:44:26 +0000 (08:44 +0200)]
Trenring: Reduce nr of builds to save RAM

Change-Id: I53e3af82a0024c8247d80e1f0401f0e9cd60e8ee
Signed-off-by: Tibor Frank <tifrank@cisco.com>
(cherry picked from commit e775f23879e7c4e9521ebafcd0117fbe57ff6bad)

2 years agoFIX: Pylint reduce 62/32662/1
pmikus [Thu, 10 Jun 2021 08:02:29 +0000 (08:02 +0000)]
FIX: Pylint reduce

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I909942dbb920df7f0fe15c0c92cda92c3cd8d8ad
(cherry picked from commit 7829fea4a2c8936513fa95215b7d84997f814a69)

2 years agoFIX: Add ICMPv6MLReport2 masking 58/32658/1
pmikus [Thu, 10 Jun 2021 08:51:19 +0000 (08:51 +0000)]
FIX: Add ICMPv6MLReport2 masking

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I1183a0ffd13c6926b3963b78630954bb6356133b
(cherry picked from commit 8b25b4e89bdba964f2a3d602b8c47f551a084724)
(cherry picked from commit aa02a041d8a6099f870d21bb5949bd741733df80)

2 years agoInfra: vpp_device -> Ubuntu 20.04 56/32656/1
pmikus [Fri, 4 Jun 2021 10:34:42 +0000 (10:34 +0000)]
Infra: vpp_device -> Ubuntu 20.04

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: If24c385b93e1ba310ea258984c97494b4cab467c
(cherry picked from commit f754eac4faf76fdbffac648769c03f5668f9f6a2)

2 years agoAdd gtpu sw performance test cases 34/32634/1
xinfeng zhao [Mon, 19 Apr 2021 05:21:52 +0000 (13:21 +0800)]
Add gtpu sw performance test cases

Signed-off-by: xinfeng zhao <xinfengx.zhao@intel.com>
Reviewed-by: Yulong Pei <yulong.pei@intel.com>
Change-Id: Ibe4420529192559a3cdbb84e0a67859750a9e0d5
(cherry picked from commit 75fe508bc9e03291977c1a28ca0adc31c3149df9)

2 years agoInfra: Decommission 3n-hsw - docs 33/32633/1
pmikus [Tue, 1 Jun 2021 11:50:11 +0000 (11:50 +0000)]
Infra: Decommission 3n-hsw - docs

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: I782fbf2d495b915cda6c25b36ffc00e8abce32f7
(cherry picked from commit dc85fa13993efce22191b41e3696301f1477fd7c)

2 years agoDpdk in VM: Increase num_mbufs 32/32632/1
Vratko Polak [Wed, 9 Jun 2021 11:27:41 +0000 (13:27 +0200)]
Dpdk in VM: Increase num_mbufs

Since switching to rxq ratio 1:1,
the previous value was not enough for 4c vhost tests.

+ Set the 1:1 rxq ratio also for DPDK (outside vhost) tests.
 - Still not sure why those tests were not failing.
+ Set the 1:1 rxq ratio also for VPP container tests.

Ticket: CSIT-1783

Change-Id: Id9d136a638eb212a8105a6288e7847f3c35fefb0
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
(cherry picked from commit 9780b57a9640e9ab40e40ec122ac80e09cd74c79)
(cherry picked from commit aa0fe4e6f83208a6f53a03103893ad5e08cd26f0)

2 years agoFIX: spectre-meltdown calibration 30/32630/1
pmikus [Wed, 9 Jun 2021 13:03:00 +0000 (13:03 +0000)]
FIX: spectre-meltdown calibration

Signed-off-by: pmikus <pmikus@cisco.com>
Change-Id: Ie162c2021d54129b48a6b3a48027b31db11d7ec6
(cherry picked from commit 924ab26cf80edfc9efb8116a2295478cd3f821ea)